Jul 06 15:17:49 devstack cinder-volume[75077]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 06 15:17:49 devstack cinder-volume[75077]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 15:17:49 devstack cinder-volume[75077]: we strongly recommend against using it for new projects. Jul 06 15:17:49 devstack cinder-volume[75077]: If you are already using Eventlet, we recommend migrating to a different Jul 06 15:17:49 devstack cinder-volume[75077]: framework. For more detail see Jul 06 15:17:49 devstack cinder-volume[75077]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 15:17:49 devstack cinder-volume[75077]: import eventlet # noqa Jul 06 15:17:52 devstack cinder-volume[75077]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75077) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 15:17:52 devstack cinder-volume[75077]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75077) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 15:17:52 devstack cinder-volume[75077]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75077) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 15:17:53 devstack cinder-volume[75077]: INFO dbcounter [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Registered counter for database cinder Jul 06 15:17:53 devstack cinder-volume[75077]: DEBUG oslo_db.sqlalchemy.engines [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75077) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 15:17:53 devstack cinder-volume[75077]: DEBUG dbcounter [-] [75077] Writer thread running {{(pid=75077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 15:17:53 devstack cinder-volume[75077]: INFO cinder.rpc [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 06 15:17:53 devstack cinder-volume[75077]: INFO cinder.rpc [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_db.sqlalchemy.engines [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75077) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 15:17:54 devstack cinder-volume[75077]: INFO cinder.volume.manager [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Determined volume DB was empty at startup. Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG cinder.volume.manager [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75077) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 06 15:17:54 devstack cinder-volume[75077]: INFO cinder.volume.manager [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 06 15:17:54 devstack cinder-volume[75077]: WARNING stevedore.named [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 15:17:54 devstack cinder-volume[75077]: WARNING castellan.key_manager [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 15:17:54 devstack cinder-volume[75077]: WARNING cinder.keymgr.conf_key_mgr [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG cinder.volume.drivers.lvm [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75077) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_concurrency.processutils [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_concurrency.processutils [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] CMD "cinder-rtstool verify" returned: 0 in 0.504s {{(pid=75077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_db.sqlalchemy.engines [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75077) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 15:17:54 devstack cinder-volume[75077]: INFO cinder.rpc [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 06 15:17:54 devstack cinder-volume[75077]: INFO cinder.rpc [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 06 15:17:54 devstack cinder-volume[75077]: WARNING stevedore.named [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 15:17:54 devstack cinder-volume[75077]: WARNING castellan.key_manager [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 15:17:54 devstack cinder-volume[75077]: INFO cinder.volume.manager [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_db.sqlalchemy.engines [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75077) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 15:17:54 devstack cinder-volume[75077]: INFO oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Starting 1 workers Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Started child 75251 {{(pid=75077) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Full set of CONF: {{(pid=75077) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] ******************************************************************************** {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Configuration options gathered from: {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] ================================================================================ {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] allow_availability_zone_fallback = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] allow_compression_on_image_upload = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] allowed_direct_url_schemes = [] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] api_rate_limit = True {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75251]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] auth_strategy = keystone {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] az_cache_duration = 3600 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_availability_zone = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_host = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_name = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_stats_polling_interval = 60 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backup_api_class = cinder.backup.api.API {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backup_name_template = backup-%s {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backup_use_same_host = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backup_use_temp_snapshot = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] chap_password = **** {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] chap_username = {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cinder_internal_tenant_project_id = 4b995712b09d42c2b60539591b40ce4b {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cinder_internal_tenant_user_id = 61d13fda05b645a593c7a1bb9ee59d56 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cloned_volume_same_az = True {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cluster = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] compression_format = gzip {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] compute_api_class = cinder.compute.nova.API {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] config_dir = [] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] config_source = [] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] control_exchange = openstack {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] debug = True {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] default_availability_zone = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] default_group_type = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] default_volume_type = lvmdriver-1 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] disk_geometry = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] driver_client_cert = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] driver_client_cert_key = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] driver_data_namespace = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] driver_ssl_cert_path = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] driver_ssl_cert_verify = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] driver_use_ssl = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] enable_force_upload = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] enable_new_services = True {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] enable_unsupported_driver = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] enforce_multipath_for_image_xfer = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] filter_function = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] glance_api_insecure = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] glance_api_servers = ['http://192.168.122.49/image'] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] glance_api_ssl_compression = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] glance_ca_certificates_file = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] glance_catalog_info = image:glance:publicURL {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] glance_certfile = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] glance_keyfile = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] glance_num_retries = 3 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] glance_request_timeout = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] goodness_function = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] graceful_shutdown_timeout = 5 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] group_api_class = cinder.group.api.API {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] host = devstack {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] image_compress_on_upload = True {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] image_conversion_address_space_limit = 1 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] image_conversion_cpu_limit = 60 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:54 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] image_conversion_disable = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] image_upload_use_cinder_backend = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] image_upload_use_internal_tenant = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] image_volume_cache_enabled = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] image_volume_cache_max_count = 0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] image_volume_cache_max_size_gb = 0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] init_host_max_objects_retrieval = 0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] instance_format = [instance: %(uuid)s] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] iscsi_target_flags = {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] iscsi_write_cache = on {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] iser_helper = tgtadm {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] iser_ip_address = 192.168.122.49 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] iser_port = 3260 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] log_color = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] log_config_append = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] log_dir = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] log_file = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] log_options = True {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] log_rotate_interval = 1 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] log_rotate_interval_type = days {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] log_rotation_type = none {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] max_age = 0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] max_logfile_count = 30 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] max_logfile_size_mb = 200 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] max_over_subscription_ratio = 20.0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] message_reap_interval = 86400 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] message_ttl = 2592000 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] migration_create_volume_timeout_secs = 300 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] monkey_patch = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] monkey_patch_modules = [] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] my_ip = 192.168.122.49 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] no_snapshot_gb_quota = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] num_iser_scan_tries = 3 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] num_shell_tries = 3 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] num_volume_device_scan_tries = 3 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] nvmeof_conn_info_version = 1 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] nvmet_ns_id = 10 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] nvmet_port_id = 1 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] osapi_max_limit = 1000 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] osapi_volume_ext_list = [] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] osapi_volume_listen_port = 8776 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] osapi_volume_use_ssl = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] osapi_volume_workers = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] per_volume_size_limit = -1 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] periodic_fuzzy_delay = 60 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] periodic_interval = 60 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] public_endpoint = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] publish_errors = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] quota_backup_gigabytes = 1000 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] quota_backups = 10 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] quota_gigabytes = 1000 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] quota_groups = 10 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] quota_snapshots = 10 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] quota_volumes = 10 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] rate_limit_burst = 0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] rate_limit_except_level = CRITICAL {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] rate_limit_interval = 0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] reinit_driver_count = 3 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] replication_device = **** {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] report_discard_supported = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] report_interval = 120 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] reservation_clean_interval = 86400 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] reservation_expire = 86400 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] reserved_image_namespaces = [] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] reserved_percentage = 0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] rpc_response_timeout = 120 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] run_external_periodic_tasks = True {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75251]: INFO cinder.volume.manager [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] scst_target_driver = iscsi {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] scst_target_iqn_name = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] service_down_time = 720 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] shell_completion = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] snapshot_name_template = snapshot-%s {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] snapshot_same_host = True {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] split_loggers = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] state_path = /opt/stack/data/cinder {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] storage_availability_zone = nova {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] storage_protocol = iSCSI {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] syslog_log_facility = LOG_USER {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] target_helper = lioadm {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] target_ip_address = 192.168.122.49 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] target_port = 3260 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] target_protocol = iscsi {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] target_secondary_ip_addresses = [] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] trace_flags = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] transport_url = **** {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] until_refresh = 0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] use_chap_auth = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] use_default_quota_class = True {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] use_journal = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] use_json = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] use_multipath_for_image_xfer = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] use_stderr = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] use_syslog = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] verify_glance_signatures = enabled {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] volume_api_class = cinder.volume.api.API {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] volume_backend_name = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] volume_clear = zero {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] volume_clear_ionice = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] volume_clear_size = 0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] volume_copy_bps_limit = 0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] volume_dd_blocksize = 1M {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] volume_name_template = volume-%s {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] volume_service_inithost_offload = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] volume_usage_audit_period = month {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] zoning_mode = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_concurrency.disable_process_locking = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.auth_section = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.auth_type = password {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.auth_version = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.cache = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.certfile = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.include_service_catalog = True {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.insecure = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.interface = public {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.keyfile = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.memcache_password = {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.memcache_username = {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.region_name = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.service_type = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.49/identity {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.backend = dogpile.cache.null {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.backend_argument = **** {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.backend_expiration_time = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.config_prefix = cache.oslo {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.debug_cache_backend = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.enable_retry_client = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.enable_socket_keepalive = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.enabled = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.expiration_time = 600 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.hashclient_retry_attempts = 2 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.memcache_dead_retry = 300 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.memcache_pool_maxsize = 10 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.memcache_sasl_enabled = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.password = **** {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.proxies = [] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.redis_db = 0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.redis_server = localhost:6379 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.retry_attempts = 2 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.retry_delay = 0.0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.socket_keepalive_count = 1 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.socket_keepalive_idle = 1 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.socket_keepalive_interval = 1 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.socket_timeout = 1.0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.tls_allowed_ciphers = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.tls_cafile = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.tls_certfile = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.tls_enabled = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.tls_keyfile = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cache.username = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] coordination.backend_url = **** {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] database.asyncio_connection = **** {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] database.asyncio_slave_connection = **** {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] database.backend = sqlalchemy {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] database.connection = **** {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] database.connection_debug = 0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] database.connection_parameters = {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] database.connection_recycle_time = 3600 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] database.connection_trace = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] database.db_inc_retry_interval = True {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] database.db_max_retries = 20 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] database.db_max_retry_interval = 10 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] database.db_retry_interval = 1 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] database.max_overflow = 50 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] database.max_pool_size = 5 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] database.max_retries = 10 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] database.mysql_wsrep_sync_wait = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] database.pool_timeout = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] database.retry_interval = 10 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] database.slave_connection = **** {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] database.sqlite_synchronous = True {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] database.synchronous_reader = True {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] database.use_db_reconnect = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] profiler.connection_string = messaging:// {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] profiler.enabled = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] profiler.es_doc_type = notification {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] profiler.es_scroll_size = 10000 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] profiler.es_scroll_time = 2m {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] profiler.filter_error_trace = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] profiler.hmac_keys = **** {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] profiler.sentinel_service_name = mymaster {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] profiler.socket_timeout = 0.1 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] profiler.trace_requests = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] profiler.trace_sqlalchemy = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] profiler_jaeger.process_tags = {} {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] profiler_jaeger.service_name_prefix = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] profiler_otlp.service_name_prefix = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_policy.enforce_new_defaults = True {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_policy.enforce_scope = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_policy.policy_default_rule = default {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_policy.policy_file = policy.yaml {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] privsep_osbrick.group = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] privsep_osbrick.helper_command = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] privsep_osbrick.user = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cinder_sys_admin.group = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cinder_sys_admin.helper_command = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] cinder_sys_admin.user = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] service_user.auth_section = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] service_user.auth_type = password {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] service_user.cafile = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] service_user.certfile = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] service_user.collect_timing = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] service_user.insecure = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] service_user.keyfile = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] service_user.send_service_user_token = True {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] service_user.split_loggers = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] service_user.timeout = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] glance.auth_section = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] glance.auth_type = password {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] glance.certfile = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] glance.collect_timing = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] glance.insecure = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] glance.keyfile = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] glance.region_name = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] glance.split_loggers = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] glance.timeout = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.backend_availability_zone = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.chap_password = **** {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.chap_username = {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.disk_geometry = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.driver_client_cert = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.driver_client_cert_key = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.driver_data_namespace = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.driver_use_ssl = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack sudo[75255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.extra_capabilities = {} {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.filter_function = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.goodness_function = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack sudo[75255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.iscsi_target_flags = {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.iscsi_write_cache = on {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.iser_helper = tgtadm {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.iser_ip_address = 192.168.122.49 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.iser_port = 3260 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.lvm_share_target = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.lvm_type = auto {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.num_shell_tries = 3 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.replication_device = **** {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.report_discard_supported = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.reserved_percentage = 0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.target_helper = tgtadm {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.target_ip_address = 192.168.122.49 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.target_port = 3260 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.target_protocol = iscsi {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.trace_flags = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.unique_fqdn_network = True {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.use_chap_auth = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.volume_backend_name = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.volume_clear = zero {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.volume_clear_ionice = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.volume_clear_size = 0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_reports.file_event_handler = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_reports.log_dir = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.backend_host = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.chap_password = **** {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.chap_username = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.disk_geometry = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.driver_client_cert = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.extra_capabilities = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.filter_function = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.goodness_function = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.iser_helper = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.iser_ip_address = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.iser_port = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.lvm_share_target = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.lvm_type = auto {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.num_shell_tries = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.replication_device = **** {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.report_discard_supported = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.reserved_percentage = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.scst_target_driver = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.storage_protocol = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.target_helper = lioadm {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.target_ip_address = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.target_port = 3260 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.trace_flags = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.use_chap_auth = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.volume_clear = zero {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.volume_clear_size = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] lvmdriver-1.volumes_dir = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.ssl = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_notifications.driver = [] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_notifications.retry = -1 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] key_manager.fixed_key = **** {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] barbican.barbican_api_version = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] barbican.barbican_endpoint = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] barbican.barbican_endpoint_type = public {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] barbican.barbican_region_name = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] barbican.cafile = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] barbican.certfile = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] barbican.collect_timing = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] barbican.insecure = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] barbican.keyfile = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] barbican.number_of_retries = 60 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] barbican.retry_delay = 1 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] barbican.send_service_user_token = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] barbican.split_loggers = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] barbican.timeout = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] barbican.verify_ssl = True {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] barbican.verify_ssl_path = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] barbican_service_user.auth_section = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] barbican_service_user.auth_type = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] barbican_service_user.cafile = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] barbican_service_user.certfile = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] barbican_service_user.collect_timing = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] barbican_service_user.insecure = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] barbican_service_user.keyfile = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] barbican_service_user.split_loggers = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] barbican_service_user.timeout = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] vault.approle_role_id = **** {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] vault.approle_secret_id = **** {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] vault.kv_mountpoint = secret {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] vault.kv_path = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] vault.kv_version = 2 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] vault.namespace = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] vault.root_token_id = **** {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] vault.ssl_ca_crt_file = None {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] vault.timeout = 60.0 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] vault.use_ssl = False {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:17:55 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] ******************************************************************************** {{(pid=75077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 06 15:17:55 devstack sudo[75255]: pam_unix(sudo:session): session closed for user root Jul 06 15:17:55 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.701s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:17:55 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:17:55 devstack sudo[75349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 15:17:55 devstack sudo[75349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:17:56 devstack sudo[75349]: pam_unix(sudo:session): session closed for user root Jul 06 15:17:56 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.687s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:17:56 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:17:56 devstack cinder-volume[75251]: INFO cinder.brick.local_dev.lvm [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 06 15:17:56 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:17:56 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:17:56 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:17:56 devstack sudo[75585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 15:17:56 devstack sudo[75585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:17:57 devstack sudo[75585]: pam_unix(sudo:session): session closed for user root Jul 06 15:17:57 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.768s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:17:57 devstack cinder-volume[75251]: DEBUG cinder.brick.local_dev.lvm [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75251) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 06 15:17:57 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:17:57 devstack sudo[75821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 15:17:57 devstack sudo[75821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:17:58 devstack sudo[75821]: pam_unix(sudo:session): session closed for user root Jul 06 15:17:58 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.423s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:17:58 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:17:58 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:17:58 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:17:58 devstack sudo[76029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 15:17:58 devstack sudo[76029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:17:59 devstack sudo[76029]: pam_unix(sudo:session): session closed for user root Jul 06 15:17:59 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.695s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:17:59 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:17:59 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:17:59 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:17:59 devstack sudo[76034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 06 15:17:59 devstack sudo[76034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:18:00 devstack sudo[76034]: pam_unix(sudo:session): session closed for user root Jul 06 15:18:00 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.832s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:18:00 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:18:00 devstack sudo[76037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 15:18:00 devstack sudo[76037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:18:00 devstack sudo[76037]: pam_unix(sudo:session): session closed for user root Jul 06 15:18:00 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.666s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:18:00 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:18:00 devstack sudo[76042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 15:18:00 devstack sudo[76042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:18:01 devstack sudo[76042]: pam_unix(sudo:session): session closed for user root Jul 06 15:18:01 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.841s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:18:01 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:18:01 devstack sudo[76054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:18:01 devstack sudo[76054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:18:02 devstack sudo[76054]: pam_unix(sudo:session): session closed for user root Jul 06 15:18:02 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.913s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:18:02 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:18:02 devstack sudo[76062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 15:18:02 devstack sudo[76062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:18:03 devstack sudo[76062]: pam_unix(sudo:session): session closed for user root Jul 06 15:18:03 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.712s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:18:03 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:18:03 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:18:03 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:18:03 devstack sudo[76068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 15:18:03 devstack sudo[76068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:18:04 devstack sudo[76068]: pam_unix(sudo:session): session closed for user root Jul 06 15:18:04 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.747s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:18:04 devstack cinder-volume[75251]: INFO cinder.volume.drivers.lvm [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 06 15:18:04 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:18:04 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:18:04 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:18:04 devstack sudo[76142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 15:18:04 devstack sudo[76142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:18:04 devstack sudo[76142]: pam_unix(sudo:session): session closed for user root Jul 06 15:18:04 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.628s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:18:04 devstack cinder-volume[75251]: DEBUG cinder.volume.drivers.lvm [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Updating volume stats {{(pid=75251) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 15:18:04 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:18:04 devstack sudo[76192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 15:18:04 devstack sudo[76192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:18:04 devstack cinder-volume[75077]: DEBUG dbcounter [-] [75077] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:18:05 devstack sudo[76192]: pam_unix(sudo:session): session closed for user root Jul 06 15:18:05 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.613s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:18:05 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:18:05 devstack sudo[76333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:18:05 devstack sudo[76333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:18:06 devstack sudo[76333]: pam_unix(sudo:session): session closed for user root Jul 06 15:18:06 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:18:06 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:18:06 devstack sudo[76336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 15:18:06 devstack sudo[76336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:18:06 devstack sudo[76336]: pam_unix(sudo:session): session closed for user root Jul 06 15:18:06 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.630s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:18:06 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:18:06 devstack sudo[76339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:18:06 devstack sudo[76339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:18:07 devstack sudo[76339]: pam_unix(sudo:session): session closed for user root Jul 06 15:18:07 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:18:07 devstack cinder-volume[75251]: INFO cinder.volume.driver [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Driver hasn't implemented _init_vendor_properties() Jul 06 15:18:07 devstack cinder-volume[75251]: DEBUG cinder.volume.driver [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75251) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 06 15:18:07 devstack cinder-volume[75251]: DEBUG oslo_db.sqlalchemy.engines [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75251) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 15:18:07 devstack cinder-volume[75251]: DEBUG dbcounter [-] [75251] Writer thread running {{(pid=75251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 15:18:07 devstack cinder-volume[75251]: DEBUG cinder.db.api [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Building query based on filter {{(pid=75251) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 06 15:18:07 devstack cinder-volume[75251]: DEBUG cinder.image.image_utils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75251) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 06 15:18:07 devstack cinder-volume[75251]: INFO cinder.keymgr.migration [None req-b56f6e9c-f3e7-4ae9-af0f-064a6df9354a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 06 15:18:07 devstack cinder-volume[75251]: DEBUG cinder.volume.drivers.lvm [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Updating volume stats {{(pid=75251) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 15:18:07 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:18:07 devstack sudo[76344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 15:18:07 devstack sudo[76344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:18:08 devstack sudo[76344]: pam_unix(sudo:session): session closed for user root Jul 06 15:18:08 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:18:08 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:18:08 devstack sudo[76348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:18:08 devstack sudo[76348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:18:08 devstack sudo[76348]: pam_unix(sudo:session): session closed for user root Jul 06 15:18:08 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:18:08 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:18:08 devstack sudo[76355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 15:18:08 devstack sudo[76355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:18:09 devstack sudo[76355]: pam_unix(sudo:session): session closed for user root Jul 06 15:18:09 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.650s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:18:09 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:18:09 devstack sudo[76359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:18:09 devstack sudo[76359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:18:10 devstack sudo[76359]: pam_unix(sudo:session): session closed for user root Jul 06 15:18:10 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:18:10 devstack cinder-volume[75251]: DEBUG cinder.manager [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Notifying Schedulers of capabilities ... {{(pid=75251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:18:10 devstack cinder-volume[75251]: INFO cinder.volume.manager [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Driver initialization completed successfully. Jul 06 15:18:10 devstack cinder-volume[75251]: INFO cinder.manager [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Initiating service 2 cleanup Jul 06 15:18:10 devstack cinder-volume[75251]: INFO cinder.manager [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Service 2 cleanup completed. Jul 06 15:18:10 devstack cinder-volume[75251]: DEBUG cinder.service [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Creating RPC server for service cinder-volume {{(pid=75251) start /opt/stack/cinder/cinder/service.py:231}} Jul 06 15:18:10 devstack cinder-volume[75251]: DEBUG cinder.service [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75251) start /opt/stack/cinder/cinder/service.py:237}} Jul 06 15:18:10 devstack cinder-volume[75251]: INFO cinder.volume.manager [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 06 15:18:10 devstack cinder-volume[75251]: DEBUG cinder.volume.drivers.lvm [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Updating volume stats {{(pid=75251) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 15:18:10 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:18:10 devstack sudo[76363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 15:18:10 devstack sudo[76363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:18:10 devstack sudo[76363]: pam_unix(sudo:session): session closed for user root Jul 06 15:18:10 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.670s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:18:10 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:18:10 devstack sudo[76366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:18:10 devstack sudo[76366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:18:11 devstack sudo[76366]: pam_unix(sudo:session): session closed for user root Jul 06 15:18:11 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.670s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:18:11 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:18:11 devstack sudo[76423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 15:18:11 devstack sudo[76423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:18:12 devstack sudo[76423]: pam_unix(sudo:session): session closed for user root Jul 06 15:18:12 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.615s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:18:12 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:18:12 devstack sudo[76429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:18:12 devstack sudo[76429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:18:12 devstack sudo[76429]: pam_unix(sudo:session): session closed for user root Jul 06 15:18:12 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:18:12 devstack cinder-volume[75251]: INFO cinder.volume.manager [None req-0f0764d1-d453-493a-a423-d062dac8deed None None] Driver post RPC initialization completed successfully. Jul 06 15:18:13 devstack cinder-volume[75251]: DEBUG oslo_service.periodic_task [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Running periodic task VolumeManager._thread_info {{(pid=75251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:18:13 devstack cinder-volume[75251]: DEBUG cinder.volume.manager [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] thread count: 6 {{(pid=75251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:18:13 devstack cinder-volume[75251]: DEBUG cinder.volume.manager [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] thread info: [<_MainThread(MainThread, started 136540778844288)>, , , , , ] {{(pid=75251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:18:22 devstack cinder-volume[75251]: DEBUG dbcounter [-] [75251] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:18:22 devstack cinder-volume[75251]: DEBUG dbcounter [-] [75251] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:19:13 devstack cinder-volume[75251]: DEBUG oslo_service.periodic_task [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:19:13 devstack cinder-volume[75251]: DEBUG cinder.volume.drivers.lvm [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Updating volume stats {{(pid=75251) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 15:19:13 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:19:13 devstack sudo[78180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 15:19:13 devstack sudo[78180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:19:14 devstack sudo[78180]: pam_unix(sudo:session): session closed for user root Jul 06 15:19:14 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:19:14 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:19:14 devstack sudo[78183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:19:14 devstack sudo[78183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:19:15 devstack sudo[78183]: pam_unix(sudo:session): session closed for user root Jul 06 15:19:15 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:19:15 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:19:15 devstack sudo[78186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 15:19:15 devstack sudo[78186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:19:15 devstack sudo[78186]: pam_unix(sudo:session): session closed for user root Jul 06 15:19:15 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.624s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:19:15 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:19:15 devstack sudo[78189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:19:15 devstack sudo[78189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:19:16 devstack sudo[78189]: pam_unix(sudo:session): session closed for user root Jul 06 15:19:16 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:19:16 devstack cinder-volume[75251]: DEBUG cinder.manager [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Notifying Schedulers of capabilities ... {{(pid=75251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:19:16 devstack cinder-volume[75251]: DEBUG oslo_service.periodic_task [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Running periodic task VolumeManager._thread_info {{(pid=75251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:19:16 devstack cinder-volume[75251]: DEBUG cinder.volume.manager [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] thread count: 6 {{(pid=75251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:19:16 devstack cinder-volume[75251]: DEBUG cinder.volume.manager [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] thread info: [<_MainThread(MainThread, started 136540778844288)>, , , , , ] {{(pid=75251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:20:13 devstack cinder-volume[75251]: DEBUG oslo_service.periodic_task [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:20:13 devstack cinder-volume[75251]: DEBUG cinder.volume.drivers.lvm [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Updating volume stats {{(pid=75251) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 15:20:13 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:13 devstack sudo[81552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 15:20:13 devstack sudo[81552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:20:14 devstack sudo[81552]: pam_unix(sudo:session): session closed for user root Jul 06 15:20:14 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:14 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:14 devstack sudo[81560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:20:14 devstack sudo[81560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:20:15 devstack sudo[81560]: pam_unix(sudo:session): session closed for user root Jul 06 15:20:15 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.610s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:15 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:15 devstack sudo[81579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 15:20:15 devstack sudo[81579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:20:15 devstack sudo[81579]: pam_unix(sudo:session): session closed for user root Jul 06 15:20:15 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.606s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:15 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:15 devstack sudo[81616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:20:15 devstack sudo[81616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:20:16 devstack sudo[81616]: pam_unix(sudo:session): session closed for user root Jul 06 15:20:16 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.615s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:16 devstack cinder-volume[75251]: DEBUG cinder.manager [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Notifying Schedulers of capabilities ... {{(pid=75251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:20:16 devstack cinder-volume[75251]: DEBUG oslo_service.periodic_task [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Running periodic task VolumeManager._thread_info {{(pid=75251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:20:16 devstack cinder-volume[75251]: DEBUG cinder.volume.manager [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] thread count: 6 {{(pid=75251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:20:16 devstack cinder-volume[75251]: DEBUG cinder.volume.manager [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] thread info: [<_MainThread(MainThread, started 136540778844288)>, , , , , ] {{(pid=75251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:20:22 devstack cinder-volume[75251]: DEBUG dbcounter [-] [75251] Writing DB stats cinder:SELECT=1 {{(pid=75251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:20:22 devstack cinder-volume[75251]: DEBUG dbcounter [-] [75251] Writing DB stats cinder:UPDATE=1 {{(pid=75251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:21:13 devstack cinder-volume[75251]: DEBUG oslo_service.periodic_task [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:21:13 devstack cinder-volume[75251]: DEBUG cinder.volume.drivers.lvm [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Updating volume stats {{(pid=75251) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 15:21:13 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:21:13 devstack sudo[83636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 15:21:13 devstack sudo[83636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:21:14 devstack sudo[83636]: pam_unix(sudo:session): session closed for user root Jul 06 15:21:14 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:21:14 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:21:14 devstack sudo[83660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:21:14 devstack sudo[83660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:21:15 devstack sudo[83660]: pam_unix(sudo:session): session closed for user root Jul 06 15:21:15 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:21:15 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:21:15 devstack sudo[83675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 15:21:15 devstack sudo[83675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:21:15 devstack sudo[83675]: pam_unix(sudo:session): session closed for user root Jul 06 15:21:15 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.704s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:21:15 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:21:15 devstack sudo[83697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:21:15 devstack sudo[83697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:21:16 devstack sudo[83697]: pam_unix(sudo:session): session closed for user root Jul 06 15:21:16 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:21:16 devstack cinder-volume[75251]: DEBUG cinder.manager [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Notifying Schedulers of capabilities ... {{(pid=75251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:21:16 devstack cinder-volume[75251]: DEBUG oslo_service.periodic_task [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Running periodic task VolumeManager._thread_info {{(pid=75251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:21:16 devstack cinder-volume[75251]: DEBUG cinder.volume.manager [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] thread count: 6 {{(pid=75251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:21:16 devstack cinder-volume[75251]: DEBUG cinder.volume.manager [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] thread info: [<_MainThread(MainThread, started 136540778844288)>, , , , , ] {{(pid=75251) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:22:13 devstack cinder-volume[75251]: DEBUG oslo_service.periodic_task [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75251) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:22:13 devstack cinder-volume[75251]: DEBUG cinder.volume.drivers.lvm [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Updating volume stats {{(pid=75251) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 15:22:13 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:22:13 devstack sudo[84975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 15:22:13 devstack sudo[84975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:22:14 devstack sudo[84975]: pam_unix(sudo:session): session closed for user root Jul 06 15:22:14 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.606s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:22:14 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:22:14 devstack sudo[84989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:22:14 devstack sudo[84989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:22:15 devstack sudo[84989]: pam_unix(sudo:session): session closed for user root Jul 06 15:22:15 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:22:15 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:22:15 devstack sudo[85015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 15:22:15 devstack sudo[85015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:22:15 devstack sudo[85015]: pam_unix(sudo:session): session closed for user root Jul 06 15:22:15 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.600s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:22:15 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:22:15 devstack sudo[85021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:22:15 devstack sudo[85021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:22:16 devstack sudo[85021]: pam_unix(sudo:session): session closed for user root Jul 06 15:22:16 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.602s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:22:16 devstack cinder-volume[75251]: DEBUG cinder.manager [None req-51ea7fca-6286-4f70-85af-aedca78ca274 None None] Notifying Schedulers of capabilities ... {{(pid=75251) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:22:22 devstack cinder-volume[75251]: DEBUG dbcounter [-] [75251] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:22:22 devstack cinder-volume[75077]: INFO oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Caught SIGTERM, stopping children Jul 06 15:22:22 devstack cinder-volume[75077]: DEBUG oslo_concurrency.lockutils [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Acquiring lock "singleton_lock" {{(pid=75077) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 15:22:22 devstack cinder-volume[75077]: DEBUG oslo_concurrency.lockutils [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Acquired lock "singleton_lock" {{(pid=75077) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 15:22:22 devstack cinder-volume[75077]: DEBUG oslo_concurrency.lockutils [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Releasing lock "singleton_lock" {{(pid=75077) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 15:22:22 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Stop services. {{(pid=75077) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 06 15:22:22 devstack cinder-volume[75077]: DEBUG oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Killing children. {{(pid=75077) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 06 15:22:22 devstack cinder-volume[75077]: INFO oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Waiting on 1 children to exit Jul 06 15:22:25 devstack cinder-volume[75251]: DEBUG oslo_concurrency.lockutils [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Acquiring lock "singleton_lock" {{(pid=75251) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 15:22:25 devstack cinder-volume[75251]: DEBUG oslo_concurrency.lockutils [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Acquired lock "singleton_lock" {{(pid=75251) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 15:22:25 devstack cinder-volume[75251]: DEBUG oslo_concurrency.lockutils [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Releasing lock "singleton_lock" {{(pid=75251) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 15:22:25 devstack cinder-volume[75251]: WARNING amqp [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 15:22:25 devstack cinder-volume[75251]: WARNING amqp [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 15:22:25 devstack cinder-volume[75077]: INFO oslo_service.backend._eventlet.service [None req-962b9443-efc8-4ab1-a2cf-446a23b5ead5 None None] Child 75251 exited with status 0 Jul 06 15:22:25 devstack cinder-volume[85329]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 06 15:22:25 devstack cinder-volume[85329]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 15:22:25 devstack cinder-volume[85329]: we strongly recommend against using it for new projects. Jul 06 15:22:25 devstack cinder-volume[85329]: If you are already using Eventlet, we recommend migrating to a different Jul 06 15:22:25 devstack cinder-volume[85329]: framework. For more detail see Jul 06 15:22:25 devstack cinder-volume[85329]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 15:22:25 devstack cinder-volume[85329]: import eventlet # noqa Jul 06 15:22:27 devstack cinder-volume[85329]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85329) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 15:22:27 devstack cinder-volume[85329]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85329) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 15:22:27 devstack cinder-volume[85329]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85329) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 15:22:28 devstack cinder-volume[85329]: INFO dbcounter [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] Registered counter for database cinder Jul 06 15:22:28 devstack cinder-volume[85329]: DEBUG oslo_db.sqlalchemy.engines [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85329) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 15:22:28 devstack cinder-volume[85329]: DEBUG dbcounter [-] [85329] Writer thread running {{(pid=85329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 15:22:28 devstack cinder-volume[85329]: INFO cinder.rpc [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 06 15:22:28 devstack cinder-volume[85329]: INFO cinder.rpc [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 06 15:22:28 devstack cinder-volume[85329]: DEBUG oslo_db.sqlalchemy.engines [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85329) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 15:22:28 devstack cinder-volume[85329]: INFO cinder.volume.manager [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] Determined volume DB was empty at startup. Jul 06 15:22:28 devstack cinder-volume[85329]: DEBUG cinder.volume.manager [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85329) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 06 15:22:29 devstack cinder-volume[85329]: INFO cinder.volume.manager [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 06 15:22:29 devstack cinder-volume[85329]: WARNING stevedore.named [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 15:22:29 devstack cinder-volume[85329]: WARNING castellan.key_manager [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 15:22:29 devstack cinder-volume[85329]: WARNING cinder.keymgr.conf_key_mgr [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 15:22:29 devstack cinder-volume[85329]: INFO cinder.volume.manager [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_db.sqlalchemy.engines [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85329) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 15:22:29 devstack cinder-volume[85329]: INFO oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] Starting 1 workers Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] Started child 85581 {{(pid=85329) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] Full set of CONF: {{(pid=85329) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] ******************************************************************************** {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] Configuration options gathered from: {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 06 15:22:29 devstack cinder-volume[85581]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] ================================================================================ {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] allow_availability_zone_fallback = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] allow_compression_on_image_upload = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] allowed_direct_url_schemes = [] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] api_rate_limit = True {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] auth_strategy = keystone {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_availability_zone = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_host = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_name = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_stats_polling_interval = 60 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backup_api_class = cinder.backup.api.API {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backup_name_template = backup-%s {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backup_use_same_host = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backup_use_temp_snapshot = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] chap_password = **** {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] chap_username = {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cinder_internal_tenant_project_id = 4b995712b09d42c2b60539591b40ce4b {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cinder_internal_tenant_user_id = 61d13fda05b645a593c7a1bb9ee59d56 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cluster = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] compression_format = gzip {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] compute_api_class = cinder.compute.nova.API {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] config_dir = [] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] config_source = [] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] control_exchange = openstack {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] debug = True {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] default_availability_zone = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] default_group_type = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] default_volume_type = QuobyteHD {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] disk_geometry = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] driver_client_cert = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] driver_client_cert_key = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] driver_data_namespace = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] driver_ssl_cert_path = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] driver_ssl_cert_verify = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] driver_use_ssl = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] enable_new_services = True {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] enable_unsupported_driver = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] enabled_backends = ['QuobyteHD'] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] enforce_multipath_for_image_xfer = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] filter_function = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] glance_api_insecure = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] glance_api_servers = ['http://192.168.122.49/image'] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] glance_api_ssl_compression = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] glance_ca_certificates_file = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] glance_catalog_info = image:glance:publicURL {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] glance_certfile = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] glance_keyfile = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] glance_num_retries = 3 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] glance_request_timeout = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] goodness_function = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] graceful_shutdown_timeout = 5 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] group_api_class = cinder.group.api.API {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] host = devstack {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] image_compress_on_upload = True {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] image_conversion_address_space_limit = 1 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] image_conversion_cpu_limit = 60 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] image_conversion_disable = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] image_upload_use_cinder_backend = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] image_upload_use_internal_tenant = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] image_volume_cache_enabled = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] image_volume_cache_max_count = 0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] image_volume_cache_max_size_gb = 0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] init_host_max_objects_retrieval = 0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] instance_format = [instance: %(uuid)s] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] iscsi_target_flags = {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] iscsi_write_cache = on {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] iser_helper = tgtadm {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] iser_ip_address = 192.168.122.49 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] iser_port = 3260 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] log_color = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] log_config_append = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] log_dir = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] log_file = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] log_options = True {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] log_rotate_interval = 1 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] log_rotate_interval_type = days {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] log_rotation_type = none {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] max_age = 0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] max_logfile_count = 30 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] max_logfile_size_mb = 200 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] max_over_subscription_ratio = 20.0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] message_reap_interval = 86400 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85581]: INFO cinder.volume.manager [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 06 15:22:29 devstack cinder-volume[85581]: DEBUG cinder.volume.drivers.remotefs [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85581) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] message_ttl = 2592000 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] migration_create_volume_timeout_secs = 300 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] monkey_patch = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] monkey_patch_modules = [] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] my_ip = 192.168.122.49 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] no_snapshot_gb_quota = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] num_iser_scan_tries = 3 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] num_shell_tries = 3 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] num_volume_device_scan_tries = 3 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] nvmeof_conn_info_version = 1 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] nvmet_ns_id = 10 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] nvmet_port_id = 1 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] osapi_max_limit = 1000 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] osapi_volume_ext_list = [] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] osapi_volume_listen_port = 8776 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] osapi_volume_use_ssl = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] osapi_volume_workers = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] per_volume_size_limit = -1 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] periodic_fuzzy_delay = 60 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] periodic_interval = 60 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] public_endpoint = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] publish_errors = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] quota_backup_gigabytes = 1000 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] quota_backups = 10 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] quota_gigabytes = 1000 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] quota_groups = 10 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] quota_snapshots = 10 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] quota_volumes = 10 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] rate_limit_burst = 0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] rate_limit_except_level = CRITICAL {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] rate_limit_interval = 0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] reinit_driver_count = 3 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] replication_device = **** {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] report_discard_supported = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] report_interval = 120 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] reservation_clean_interval = 86400 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] reservation_expire = 86400 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] reserved_image_namespaces = [] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] reserved_percentage = 0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] rpc_response_timeout = 120 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] run_external_periodic_tasks = True {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] scst_target_driver = iscsi {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] scst_target_iqn_name = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] service_down_time = 720 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] shell_completion = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] snapshot_name_template = snapshot-%s {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] split_loggers = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] state_path = /opt/stack/data/cinder {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] storage_availability_zone = nova {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] storage_protocol = iSCSI {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] syslog_log_facility = LOG_USER {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] target_helper = lioadm {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] target_ip_address = 192.168.122.49 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] target_port = 3260 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] target_protocol = iscsi {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] target_secondary_ip_addresses = [] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] trace_flags = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] transport_url = **** {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] until_refresh = 0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] use_chap_auth = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] use_default_quota_class = True {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] use_journal = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] use_json = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] use_multipath_for_image_xfer = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] use_stderr = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] use_syslog = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] verify_glance_signatures = enabled {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] volume_api_class = cinder.volume.api.API {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] volume_backend_name = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] volume_clear = zero {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] volume_clear_ionice = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] volume_clear_size = 0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] volume_copy_bps_limit = 0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] volume_dd_blocksize = 1M {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] volume_name_template = volume-%s {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] volume_service_inithost_offload = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] volume_usage_audit_period = month {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] zoning_mode = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_concurrency.disable_process_locking = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.auth_section = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.auth_type = password {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.auth_version = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.cache = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.certfile = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.include_service_catalog = True {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.insecure = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.interface = public {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.keyfile = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.memcache_password = {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.memcache_username = {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.region_name = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.service_type = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.49/identity {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.backend = dogpile.cache.null {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.backend_argument = **** {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.backend_expiration_time = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.config_prefix = cache.oslo {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.debug_cache_backend = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.enable_retry_client = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.enable_socket_keepalive = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.enabled = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.expiration_time = 600 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.hashclient_retry_attempts = 2 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.memcache_dead_retry = 300 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.memcache_pool_maxsize = 10 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85581]: DEBUG cinder.volume.drivers.quobyte [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85581) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 06 15:22:29 devstack cinder-volume[85581]: WARNING cinder.volume.drivers.quobyte [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.memcache_sasl_enabled = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.password = **** {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.proxies = [] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.redis_db = 0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.redis_server = localhost:6379 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.retry_attempts = 2 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.retry_delay = 0.0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.socket_keepalive_count = 1 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.socket_keepalive_idle = 1 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.socket_keepalive_interval = 1 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85581]: WARNING cinder.volume.drivers.quobyte [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.socket_timeout = 1.0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.tls_allowed_ciphers = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85581]: DEBUG oslo_concurrency.processutils [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Running cmd (subprocess): mount.quobyte {{(pid=85581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.tls_cafile = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.tls_certfile = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.tls_enabled = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.tls_keyfile = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cache.username = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] coordination.backend_url = **** {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] database.asyncio_connection = **** {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] database.asyncio_slave_connection = **** {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] database.backend = sqlalchemy {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] database.connection = **** {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] database.connection_debug = 0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] database.connection_parameters = {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] database.connection_recycle_time = 3600 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] database.connection_trace = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] database.db_inc_retry_interval = True {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] database.db_max_retries = 20 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] database.db_max_retry_interval = 10 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] database.db_retry_interval = 1 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] database.max_overflow = 50 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] database.max_pool_size = 5 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] database.max_retries = 10 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] database.mysql_wsrep_sync_wait = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] database.pool_timeout = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] database.retry_interval = 10 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] database.slave_connection = **** {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] database.sqlite_synchronous = True {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] database.synchronous_reader = True {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] database.use_db_reconnect = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] profiler.connection_string = messaging:// {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] profiler.enabled = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] profiler.es_doc_type = notification {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] profiler.es_scroll_size = 10000 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] profiler.es_scroll_time = 2m {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] profiler.filter_error_trace = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] profiler.hmac_keys = **** {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] profiler.sentinel_service_name = mymaster {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] profiler.socket_timeout = 0.1 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] profiler.trace_requests = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] profiler.trace_sqlalchemy = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] profiler_jaeger.process_tags = {} {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] profiler_jaeger.service_name_prefix = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] profiler_otlp.service_name_prefix = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_policy.enforce_new_defaults = True {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_policy.enforce_scope = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_policy.policy_default_rule = default {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_policy.policy_file = policy.yaml {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] privsep_osbrick.group = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] privsep_osbrick.helper_command = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] privsep_osbrick.user = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cinder_sys_admin.group = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cinder_sys_admin.helper_command = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] cinder_sys_admin.user = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] service_user.auth_section = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] service_user.auth_type = password {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] service_user.cafile = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] service_user.certfile = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] service_user.collect_timing = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] service_user.insecure = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] service_user.keyfile = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] service_user.send_service_user_token = True {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] service_user.split_loggers = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] service_user.timeout = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] glance.auth_section = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] glance.auth_type = password {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] glance.certfile = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] glance.collect_timing = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] glance.insecure = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] glance.keyfile = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] glance.region_name = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] glance.split_loggers = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] glance.timeout = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.backend_availability_zone = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.chap_password = **** {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.chap_username = {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.disk_geometry = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.driver_client_cert = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.driver_client_cert_key = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.driver_data_namespace = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.driver_use_ssl = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.extra_capabilities = {} {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.filter_function = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.goodness_function = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.iscsi_target_flags = {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.iscsi_write_cache = on {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.iser_helper = tgtadm {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.iser_ip_address = 192.168.122.49 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.iser_port = 3260 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.nas_host = {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.nas_login = admin {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.nas_mount_options = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.nas_password = **** {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.nas_private_key = {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.nas_share_path = {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.num_shell_tries = 3 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.quobyte_volume_url = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.replication_device = **** {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.report_discard_supported = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.reserved_percentage = 0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack quobyte-client[85584]: Reading configuration file: /etc/quobyte/client.cfg Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.target_helper = tgtadm {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.target_ip_address = 192.168.122.49 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.target_port = 3260 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack quobyte-client[85584]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.target_protocol = iscsi {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.trace_flags = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.unique_fqdn_network = True {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.use_chap_auth = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.volume_backend_name = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.volume_clear = zero {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.volume_clear_ionice = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.volume_clear_size = 0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_reports.file_event_handler = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_reports.log_dir = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.backend_availability_zone = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.backend_host = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.chap_password = **** {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.chap_username = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.chiscsi_conf = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.disk_geometry = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.driver_client_cert = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.driver_data_namespace = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.driver_use_ssl = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.extra_capabilities = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.filter_function = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.goodness_function = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85581]: DEBUG oslo_concurrency.processutils [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] CMD "mount.quobyte" returned: 1 in 0.075s {{(pid=85581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.iser_helper = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.iser_ip_address = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85581]: DEBUG oslo_concurrency.lockutils [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.iser_port = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85581]: DEBUG oslo_concurrency.lockutils [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:22:29 devstack cinder-volume[85581]: DEBUG cinder.volume.drivers.quobyte [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=85581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.iser_target_prefix = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.nas_host = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85581]: INFO cinder.volume.drivers.quobyte [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce ... Jul 06 15:22:29 devstack cinder-volume[85581]: DEBUG oslo_concurrency.processutils [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 -c /etc/quobyte/client-cinder.cfg {{(pid=85581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.nas_login = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.nas_mount_options = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.nas_password = **** {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.nas_private_key = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.nas_share_path = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.nas_ssh_port = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.num_shell_tries = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.nvmet_port_id = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.replication_device = **** {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.report_discard_supported = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.reserved_percentage = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.scst_target_driver = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.storage_protocol = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.target_helper = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.target_ip_address = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.target_port = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.target_prefix = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.target_protocol = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.trace_flags = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.use_chap_auth = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.volume_clear = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.volume_clear_size = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] QuobyteHD.volumes_dir = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.ssl = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack sudo[85585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 -c /etc/quobyte/client-cinder.cfg Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_notifications.driver = [] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_notifications.retry = -1 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack sudo[85585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] key_manager.fixed_key = **** {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] barbican.barbican_api_version = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] barbican.barbican_endpoint = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] barbican.barbican_endpoint_type = public {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] barbican.barbican_region_name = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] barbican.cafile = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] barbican.certfile = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] barbican.collect_timing = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] barbican.insecure = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] barbican.keyfile = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] barbican.number_of_retries = 60 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] barbican.retry_delay = 1 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] barbican.send_service_user_token = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] barbican.split_loggers = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] barbican.timeout = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] barbican.verify_ssl = True {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] barbican.verify_ssl_path = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] barbican_service_user.auth_section = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] barbican_service_user.auth_type = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] barbican_service_user.cafile = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] barbican_service_user.certfile = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] barbican_service_user.collect_timing = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] barbican_service_user.insecure = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] barbican_service_user.keyfile = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] barbican_service_user.split_loggers = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] barbican_service_user.timeout = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] vault.approle_role_id = **** {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] vault.approle_secret_id = **** {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] vault.kv_mountpoint = secret {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] vault.kv_path = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] vault.kv_version = 2 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] vault.namespace = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] vault.root_token_id = **** {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] vault.ssl_ca_crt_file = None {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] vault.timeout = 60.0 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] vault.use_ssl = False {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:29 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] ******************************************************************************** {{(pid=85329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 06 15:22:30 devstack sudo[85585]: pam_unix(sudo:session): session closed for user root Jul 06 15:22:30 devstack cinder-volume[85581]: DEBUG oslo_concurrency.processutils [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.909s {{(pid=85581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:22:30 devstack cinder-volume[85581]: INFO cinder.volume.drivers.quobyte [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce succeeded Jul 06 15:22:30 devstack cinder-volume[85581]: DEBUG cinder.volume.drivers.quobyte [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=85581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:22:30 devstack cinder-volume[85581]: DEBUG oslo_concurrency.lockutils [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.925s {{(pid=85581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:22:30 devstack cinder-volume[85581]: DEBUG oslo_concurrency.processutils [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=85581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:22:30 devstack sudo[85671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:22:30 devstack sudo[85671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:22:31 devstack sudo[85671]: pam_unix(sudo:session): session closed for user root Jul 06 15:22:31 devstack cinder-volume[85581]: DEBUG oslo_concurrency.processutils [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.761s {{(pid=85581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:22:31 devstack cinder-volume[85581]: INFO cinder.volume.driver [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Driver hasn't implemented _init_vendor_properties() Jul 06 15:22:31 devstack cinder-volume[85581]: DEBUG cinder.volume.driver [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85581) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 06 15:22:31 devstack cinder-volume[85581]: DEBUG oslo_db.sqlalchemy.engines [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85581) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 15:22:31 devstack cinder-volume[85581]: DEBUG dbcounter [-] [85581] Writer thread running {{(pid=85581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 15:22:31 devstack cinder-volume[85581]: DEBUG cinder.db.api [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Building query based on filter {{(pid=85581) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 06 15:22:31 devstack cinder-volume[85581]: DEBUG cinder.image.image_utils [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85581) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 06 15:22:31 devstack cinder-volume[85581]: INFO cinder.keymgr.migration [None req-4ebfb9ff-a710-4b65-be8c-67970ed73779 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 06 15:22:31 devstack cinder-volume[85581]: DEBUG oslo_concurrency.lockutils [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:22:31 devstack cinder-volume[85581]: DEBUG oslo_concurrency.lockutils [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:22:31 devstack cinder-volume[85581]: DEBUG cinder.volume.drivers.quobyte [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=85581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:22:31 devstack cinder-volume[85581]: DEBUG cinder.volume.drivers.quobyte [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=85581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:22:31 devstack cinder-volume[85581]: DEBUG oslo_concurrency.lockutils [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:22:31 devstack cinder-volume[85581]: DEBUG oslo_concurrency.processutils [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=85581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:22:31 devstack sudo[85761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:22:31 devstack sudo[85761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:22:32 devstack sudo[85761]: pam_unix(sudo:session): session closed for user root Jul 06 15:22:32 devstack cinder-volume[85581]: DEBUG oslo_concurrency.processutils [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.753s {{(pid=85581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:22:32 devstack cinder-volume[85581]: DEBUG cinder.manager [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Notifying Schedulers of capabilities ... {{(pid=85581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:22:32 devstack cinder-volume[85581]: INFO cinder.volume.manager [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Driver initialization completed successfully. Jul 06 15:22:32 devstack cinder-volume[85581]: INFO cinder.manager [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Initiating service 3 cleanup Jul 06 15:22:32 devstack cinder-volume[85581]: INFO cinder.manager [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Service 3 cleanup completed. Jul 06 15:22:32 devstack cinder-volume[85581]: DEBUG cinder.service [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Creating RPC server for service cinder-volume {{(pid=85581) start /opt/stack/cinder/cinder/service.py:231}} Jul 06 15:22:32 devstack cinder-volume[85581]: DEBUG cinder.service [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85581) start /opt/stack/cinder/cinder/service.py:237}} Jul 06 15:22:32 devstack cinder-volume[85581]: INFO cinder.volume.manager [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 06 15:22:32 devstack cinder-volume[85581]: DEBUG oslo_concurrency.lockutils [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:22:32 devstack cinder-volume[85581]: DEBUG oslo_concurrency.lockutils [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:22:32 devstack cinder-volume[85581]: DEBUG cinder.volume.drivers.quobyte [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=85581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:22:32 devstack cinder-volume[85581]: DEBUG cinder.volume.drivers.quobyte [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=85581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:22:32 devstack cinder-volume[85581]: DEBUG oslo_concurrency.lockutils [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:22:32 devstack cinder-volume[85581]: DEBUG oslo_concurrency.processutils [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=85581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:22:32 devstack sudo[85772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:22:32 devstack sudo[85772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:22:32 devstack sudo[85772]: pam_unix(sudo:session): session closed for user root Jul 06 15:22:32 devstack cinder-volume[85581]: DEBUG oslo_concurrency.processutils [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.623s {{(pid=85581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:22:33 devstack cinder-volume[85581]: INFO cinder.volume.manager [None req-e663d31a-ddbd-4335-8f63-fe2bfbc4c1d0 None None] Driver post RPC initialization completed successfully. Jul 06 15:22:34 devstack cinder-volume[85581]: DEBUG oslo_concurrency.lockutils [None req-744346ff-f29d-48fd-a34d-595d7e30ab37 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:22:34 devstack cinder-volume[85581]: DEBUG oslo_concurrency.lockutils [None req-744346ff-f29d-48fd-a34d-595d7e30ab37 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:22:34 devstack cinder-volume[85581]: DEBUG cinder.volume.drivers.quobyte [None req-744346ff-f29d-48fd-a34d-595d7e30ab37 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=85581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:22:34 devstack cinder-volume[85581]: DEBUG cinder.volume.drivers.quobyte [None req-744346ff-f29d-48fd-a34d-595d7e30ab37 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=85581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:22:34 devstack cinder-volume[85581]: DEBUG oslo_concurrency.lockutils [None req-744346ff-f29d-48fd-a34d-595d7e30ab37 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:22:34 devstack cinder-volume[85581]: DEBUG oslo_concurrency.processutils [None req-744346ff-f29d-48fd-a34d-595d7e30ab37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=85581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:22:34 devstack sudo[85779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:22:34 devstack sudo[85779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:22:35 devstack sudo[85779]: pam_unix(sudo:session): session closed for user root Jul 06 15:22:35 devstack cinder-volume[85581]: DEBUG oslo_concurrency.processutils [None req-744346ff-f29d-48fd-a34d-595d7e30ab37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.590s {{(pid=85581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:22:35 devstack cinder-volume[85581]: DEBUG cinder.manager [None req-744346ff-f29d-48fd-a34d-595d7e30ab37 None None] Notifying Schedulers of capabilities ... {{(pid=85581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:22:37 devstack cinder-volume[85329]: INFO oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] Caught SIGTERM, stopping children Jul 06 15:22:37 devstack cinder-volume[85329]: DEBUG oslo_concurrency.lockutils [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] Acquiring lock "singleton_lock" {{(pid=85329) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 15:22:37 devstack cinder-volume[85329]: DEBUG oslo_concurrency.lockutils [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] Acquired lock "singleton_lock" {{(pid=85329) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 15:22:37 devstack cinder-volume[85329]: DEBUG oslo_concurrency.lockutils [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] Releasing lock "singleton_lock" {{(pid=85329) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 15:22:37 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] Stop services. {{(pid=85329) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 06 15:22:37 devstack cinder-volume[85329]: DEBUG oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] Killing children. {{(pid=85329) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 06 15:22:37 devstack cinder-volume[85329]: INFO oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] Waiting on 1 children to exit Jul 06 15:22:40 devstack cinder-volume[85581]: DEBUG oslo_concurrency.lockutils [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] Acquiring lock "singleton_lock" {{(pid=85581) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 15:22:40 devstack cinder-volume[85581]: DEBUG oslo_concurrency.lockutils [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] Acquired lock "singleton_lock" {{(pid=85581) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 15:22:40 devstack cinder-volume[85581]: DEBUG oslo_concurrency.lockutils [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] Releasing lock "singleton_lock" {{(pid=85581) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 15:22:40 devstack cinder-volume[85581]: WARNING amqp [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 15:22:40 devstack cinder-volume[85581]: WARNING amqp [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 15:22:40 devstack cinder-volume[85329]: INFO oslo_service.backend._eventlet.service [None req-8430c9c2-a4d5-4021-98e6-631dcd046e35 None None] Child 85581 exited with status 0 Jul 06 15:22:41 devstack cinder-volume[85864]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 06 15:22:41 devstack cinder-volume[85864]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 15:22:41 devstack cinder-volume[85864]: we strongly recommend against using it for new projects. Jul 06 15:22:41 devstack cinder-volume[85864]: If you are already using Eventlet, we recommend migrating to a different Jul 06 15:22:41 devstack cinder-volume[85864]: framework. For more detail see Jul 06 15:22:41 devstack cinder-volume[85864]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 15:22:41 devstack cinder-volume[85864]: import eventlet # noqa Jul 06 15:22:44 devstack cinder-volume[85864]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85864) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 15:22:44 devstack cinder-volume[85864]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85864) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 15:22:44 devstack cinder-volume[85864]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85864) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 15:22:45 devstack cinder-volume[85864]: INFO dbcounter [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] Registered counter for database cinder Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_db.sqlalchemy.engines [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85864) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG dbcounter [-] [85864] Writer thread running {{(pid=85864) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 15:22:45 devstack cinder-volume[85864]: INFO cinder.rpc [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 06 15:22:45 devstack cinder-volume[85864]: INFO cinder.rpc [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_db.sqlalchemy.engines [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85864) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 15:22:45 devstack cinder-volume[85864]: INFO cinder.volume.manager [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] Determined volume DB was empty at startup. Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG cinder.volume.manager [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85864) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 06 15:22:45 devstack cinder-volume[85864]: WARNING stevedore.named [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 15:22:45 devstack cinder-volume[85864]: WARNING castellan.key_manager [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 15:22:45 devstack cinder-volume[85864]: WARNING cinder.keymgr.conf_key_mgr [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 15:22:45 devstack cinder-volume[85864]: INFO cinder.volume.manager [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_db.sqlalchemy.engines [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85864) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 15:22:45 devstack cinder-volume[85864]: INFO oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] Starting 1 workers Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] Started child 86148 {{(pid=85864) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] Full set of CONF: {{(pid=85864) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] ******************************************************************************** {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] Configuration options gathered from: {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] ================================================================================ {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] allow_availability_zone_fallback = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] allow_compression_on_image_upload = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] allowed_direct_url_schemes = [] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] api_rate_limit = True {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] auth_strategy = keystone {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_availability_zone = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[86148]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_host = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_name = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_stats_polling_interval = 60 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backup_api_class = cinder.backup.api.API {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backup_name_template = backup-%s {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backup_use_same_host = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backup_use_temp_snapshot = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] chap_password = **** {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] chap_username = {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cinder_internal_tenant_project_id = 4b995712b09d42c2b60539591b40ce4b {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cinder_internal_tenant_user_id = 61d13fda05b645a593c7a1bb9ee59d56 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cluster = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] compression_format = gzip {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] compute_api_class = cinder.compute.nova.API {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] config_dir = [] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] config_source = [] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] control_exchange = openstack {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] debug = True {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] default_availability_zone = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] default_group_type = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] default_volume_type = QuobyteHD {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] disk_geometry = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] driver_client_cert = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] driver_client_cert_key = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] driver_data_namespace = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] driver_ssl_cert_path = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] driver_ssl_cert_verify = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] driver_use_ssl = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] enable_new_services = True {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] enable_unsupported_driver = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] enabled_backends = ['QuobyteHD'] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] enforce_multipath_for_image_xfer = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] filter_function = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] glance_api_insecure = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] glance_api_servers = ['http://192.168.122.49/image'] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] glance_api_ssl_compression = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] glance_ca_certificates_file = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] glance_catalog_info = image:glance:publicURL {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] glance_certfile = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] glance_keyfile = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] glance_num_retries = 3 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] glance_request_timeout = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] goodness_function = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] graceful_shutdown_timeout = 5 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] group_api_class = cinder.group.api.API {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] host = devstack {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] image_compress_on_upload = True {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:45 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] image_conversion_address_space_limit = 1 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] image_conversion_cpu_limit = 60 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] image_conversion_disable = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] image_upload_use_cinder_backend = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] image_upload_use_internal_tenant = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] image_volume_cache_enabled = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] image_volume_cache_max_count = 0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] image_volume_cache_max_size_gb = 0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] init_host_max_objects_retrieval = 0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] instance_format = [instance: %(uuid)s] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] iscsi_target_flags = {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] iscsi_write_cache = on {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] iser_helper = tgtadm {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] iser_ip_address = 192.168.122.49 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] iser_port = 3260 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] log_color = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] log_config_append = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] log_dir = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] log_file = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] log_options = True {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] log_rotate_interval = 1 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] log_rotate_interval_type = days {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] log_rotation_type = none {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] max_age = 0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] max_logfile_count = 30 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] max_logfile_size_mb = 200 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] max_over_subscription_ratio = 20.0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] message_reap_interval = 86400 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] message_ttl = 2592000 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] migration_create_volume_timeout_secs = 300 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] monkey_patch = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] monkey_patch_modules = [] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] my_ip = 192.168.122.49 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] no_snapshot_gb_quota = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] num_iser_scan_tries = 3 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] num_shell_tries = 3 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] num_volume_device_scan_tries = 3 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] nvmeof_conn_info_version = 1 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] nvmet_ns_id = 10 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] nvmet_port_id = 1 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] osapi_max_limit = 1000 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] osapi_volume_ext_list = [] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] osapi_volume_listen_port = 8776 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] osapi_volume_use_ssl = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] osapi_volume_workers = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] per_volume_size_limit = -1 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] periodic_fuzzy_delay = 60 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] periodic_interval = 60 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] public_endpoint = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] publish_errors = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] quota_backup_gigabytes = 1000 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] quota_backups = 10 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] quota_gigabytes = 1000 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] quota_groups = 10 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] quota_snapshots = 10 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] quota_volumes = 10 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] rate_limit_burst = 0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] rate_limit_except_level = CRITICAL {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] rate_limit_interval = 0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] reinit_driver_count = 3 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] replication_device = **** {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] report_discard_supported = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] report_interval = 120 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] reservation_clean_interval = 86400 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] reservation_expire = 86400 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] reserved_image_namespaces = [] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] reserved_percentage = 0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] rpc_response_timeout = 120 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] run_external_periodic_tasks = True {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] scst_target_driver = iscsi {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] scst_target_iqn_name = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] service_down_time = 720 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] shell_completion = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] snapshot_name_template = snapshot-%s {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] split_loggers = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] state_path = /opt/stack/data/cinder {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] storage_availability_zone = nova {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] storage_protocol = iSCSI {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] syslog_log_facility = LOG_USER {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] target_helper = lioadm {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] target_ip_address = 192.168.122.49 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] target_port = 3260 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] target_protocol = iscsi {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] target_secondary_ip_addresses = [] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] trace_flags = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] transport_url = **** {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] until_refresh = 0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] use_chap_auth = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] use_default_quota_class = True {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] use_journal = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] use_json = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] use_multipath_for_image_xfer = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] use_stderr = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] use_syslog = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] verify_glance_signatures = enabled {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] volume_api_class = cinder.volume.api.API {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] volume_backend_name = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] volume_clear = zero {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] volume_clear_ionice = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] volume_clear_size = 0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] volume_copy_bps_limit = 0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] volume_dd_blocksize = 1M {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] volume_name_template = volume-%s {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] volume_service_inithost_offload = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] volume_usage_audit_period = month {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] zoning_mode = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_concurrency.disable_process_locking = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.auth_section = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.auth_type = password {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.auth_version = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.cache = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.certfile = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.include_service_catalog = True {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.insecure = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.interface = public {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.keyfile = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Starting volume driver QuobyteDriver (1.1.14) Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.memcache_password = {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86148) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.memcache_username = {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.region_name = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.service_type = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.49/identity {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.backend = dogpile.cache.null {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.backend_argument = **** {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.backend_expiration_time = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.config_prefix = cache.oslo {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.debug_cache_backend = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.enable_retry_client = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.enable_socket_keepalive = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.enabled = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.expiration_time = 600 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.hashclient_retry_attempts = 2 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.memcache_dead_retry = 300 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.memcache_pool_maxsize = 10 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.memcache_sasl_enabled = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.password = **** {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.proxies = [] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.redis_db = 0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.redis_server = localhost:6379 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.retry_attempts = 2 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.retry_delay = 0.0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.socket_keepalive_count = 1 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.socket_keepalive_idle = 1 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.socket_keepalive_interval = 1 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.socket_timeout = 1.0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.tls_allowed_ciphers = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.tls_cafile = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.tls_certfile = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.tls_enabled = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.tls_keyfile = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cache.username = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] coordination.backend_url = **** {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] database.asyncio_connection = **** {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] database.asyncio_slave_connection = **** {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] database.backend = sqlalchemy {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] database.connection = **** {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] database.connection_debug = 0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] database.connection_parameters = {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] database.connection_recycle_time = 3600 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] database.connection_trace = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] database.db_inc_retry_interval = True {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] database.db_max_retries = 20 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] database.db_max_retry_interval = 10 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] database.db_retry_interval = 1 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] database.max_overflow = 50 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] database.max_pool_size = 5 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] database.max_retries = 10 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] database.mysql_wsrep_sync_wait = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] database.pool_timeout = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] database.retry_interval = 10 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] database.slave_connection = **** {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] database.sqlite_synchronous = True {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] database.synchronous_reader = True {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] database.use_db_reconnect = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] profiler.connection_string = messaging:// {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] profiler.enabled = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] profiler.es_doc_type = notification {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] profiler.es_scroll_size = 10000 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] profiler.es_scroll_time = 2m {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] profiler.filter_error_trace = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] profiler.hmac_keys = **** {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] profiler.sentinel_service_name = mymaster {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] profiler.socket_timeout = 0.1 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] profiler.trace_requests = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] profiler.trace_sqlalchemy = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] profiler_jaeger.process_tags = {} {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] profiler_jaeger.service_name_prefix = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] profiler_otlp.service_name_prefix = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_policy.enforce_new_defaults = True {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_policy.enforce_scope = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_policy.policy_default_rule = default {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_policy.policy_file = policy.yaml {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] privsep_osbrick.group = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] privsep_osbrick.helper_command = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] privsep_osbrick.user = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cinder_sys_admin.group = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cinder_sys_admin.helper_command = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] cinder_sys_admin.user = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] service_user.auth_section = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] service_user.auth_type = password {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] service_user.cafile = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] service_user.certfile = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] service_user.collect_timing = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] service_user.insecure = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] service_user.keyfile = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] service_user.send_service_user_token = True {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] service_user.split_loggers = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] service_user.timeout = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] glance.auth_section = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] glance.auth_type = password {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] glance.certfile = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] glance.collect_timing = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] glance.insecure = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] glance.keyfile = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] glance.region_name = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] glance.split_loggers = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] glance.timeout = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.backend_availability_zone = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.chap_password = **** {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.chap_username = {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.disk_geometry = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.driver_client_cert = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.driver_client_cert_key = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.driver_data_namespace = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.driver_use_ssl = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.extra_capabilities = {} {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.filter_function = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.goodness_function = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.iscsi_target_flags = {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.iscsi_write_cache = on {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.iser_helper = tgtadm {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.iser_ip_address = 192.168.122.49 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.iser_port = 3260 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.nas_host = {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.nas_login = admin {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.nas_mount_options = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.nas_password = **** {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.nas_private_key = {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.nas_share_path = {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.num_shell_tries = 3 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.quobyte_volume_url = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.replication_device = **** {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.report_discard_supported = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.reserved_percentage = 0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.target_helper = tgtadm {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.target_ip_address = 192.168.122.49 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.target_port = 3260 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.target_protocol = iscsi {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.trace_flags = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.unique_fqdn_network = True {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.use_chap_auth = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.volume_backend_name = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.volume_clear = zero {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.volume_clear_ionice = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.volume_clear_size = 0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_reports.file_event_handler = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_reports.log_dir = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.backend_availability_zone = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.backend_host = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.chap_password = **** {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.chap_username = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.chiscsi_conf = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.disk_geometry = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.driver_client_cert = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.driver_data_namespace = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.driver_use_ssl = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.extra_capabilities = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.filter_function = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.goodness_function = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.iser_helper = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.iser_ip_address = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.iser_port = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.iser_target_prefix = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.nas_host = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.nas_login = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.nas_mount_options = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.nas_password = **** {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.nas_private_key = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86148) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.nas_share_path = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.quobyte [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 06 15:22:46 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.quobyte [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.nas_ssh_port = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.num_shell_tries = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.nvmet_port_id = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.replication_device = **** {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.report_discard_supported = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.reserved_percentage = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.scst_target_driver = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.storage_protocol = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.target_helper = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Running cmd (subprocess): mount.quobyte {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.target_ip_address = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.target_port = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.target_prefix = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.target_protocol = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.trace_flags = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.use_chap_auth = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.volume_clear = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.volume_clear_size = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] QuobyteHD.volumes_dir = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.ssl = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_notifications.driver = [] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_notifications.retry = -1 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] key_manager.fixed_key = **** {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] barbican.barbican_api_version = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] barbican.barbican_endpoint = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] barbican.barbican_endpoint_type = public {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] barbican.barbican_region_name = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] barbican.cafile = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] barbican.certfile = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] barbican.collect_timing = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] barbican.insecure = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] barbican.keyfile = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] barbican.number_of_retries = 60 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] barbican.retry_delay = 1 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] barbican.send_service_user_token = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] barbican.split_loggers = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] barbican.timeout = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] barbican.verify_ssl = True {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] barbican.verify_ssl_path = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] barbican_service_user.auth_section = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] barbican_service_user.auth_type = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] barbican_service_user.cafile = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] barbican_service_user.certfile = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] barbican_service_user.collect_timing = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] barbican_service_user.insecure = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] barbican_service_user.keyfile = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] barbican_service_user.split_loggers = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] barbican_service_user.timeout = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] vault.approle_role_id = **** {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] vault.approle_secret_id = **** {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] vault.kv_mountpoint = secret {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] vault.kv_path = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] vault.kv_version = 2 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] vault.namespace = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] vault.root_token_id = **** {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] vault.ssl_ca_crt_file = None {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] vault.timeout = 60.0 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] vault.use_ssl = False {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:22:46 devstack cinder-volume[85864]: DEBUG oslo_service.backend._eventlet.service [None req-cec5d352-6ffc-4d02-a9cd-21889ef52769 None None] ******************************************************************************** {{(pid=85864) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 06 15:22:46 devstack quobyte-client[86149]: Reading configuration file: /etc/quobyte/client.cfg Jul 06 15:22:46 devstack quobyte-client[86149]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 06 15:22:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] CMD "mount.quobyte" returned: 1 in 0.063s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:22:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:22:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:22:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:22:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:22:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:22:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:22:46 devstack sudo[86150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:22:46 devstack sudo[86150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:22:46 devstack sudo[86150]: pam_unix(sudo:session): session closed for user root Jul 06 15:22:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.655s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:22:46 devstack cinder-volume[86148]: INFO cinder.volume.driver [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Driver hasn't implemented _init_vendor_properties() Jul 06 15:22:46 devstack cinder-volume[86148]: DEBUG cinder.volume.driver [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86148) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 06 15:22:46 devstack cinder-volume[86148]: DEBUG oslo_db.sqlalchemy.engines [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86148) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 15:22:46 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writer thread running {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 15:22:46 devstack cinder-volume[86148]: DEBUG cinder.db.api [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Building query based on filter {{(pid=86148) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 06 15:22:47 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86148) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 06 15:22:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:22:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:22:47 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:22:47 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:22:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:22:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:22:47 devstack cinder-volume[86148]: INFO cinder.keymgr.migration [None req-0cdae233-f329-4c3e-b972-d5af287db2f7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 06 15:22:47 devstack sudo[86171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:22:47 devstack sudo[86171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:22:47 devstack sudo[86171]: pam_unix(sudo:session): session closed for user root Jul 06 15:22:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.601s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:22:47 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:22:47 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Driver initialization completed successfully. Jul 06 15:22:47 devstack cinder-volume[86148]: INFO cinder.manager [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Initiating service 3 cleanup Jul 06 15:22:47 devstack cinder-volume[86148]: INFO cinder.manager [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Service 3 cleanup completed. Jul 06 15:22:47 devstack cinder-volume[86148]: DEBUG cinder.service [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Creating RPC server for service cinder-volume {{(pid=86148) start /opt/stack/cinder/cinder/service.py:231}} Jul 06 15:22:47 devstack cinder-volume[86148]: DEBUG cinder.service [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86148) start /opt/stack/cinder/cinder/service.py:237}} Jul 06 15:22:47 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 06 15:22:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:22:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:22:47 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:22:47 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:22:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:22:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:22:47 devstack sudo[86191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:22:47 devstack sudo[86191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:22:48 devstack sudo[86191]: pam_unix(sudo:session): session closed for user root Jul 06 15:22:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.617s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:22:48 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-5ff660f9-6070-40d8-b617-d24f4145327b None None] Driver post RPC initialization completed successfully. Jul 06 15:22:55 devstack cinder-volume[85864]: DEBUG dbcounter [-] [85864] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85864) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:22:57 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=3 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:22:58 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:23:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager._thread_info {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:23:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread count: 6 {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:23:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread info: [<_MainThread(MainThread, started 124857273856128)>, , , , , ] {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:23:46 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:23:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Flow 'volume_create_manager' (afe33796-8b86-4d92-86f2-c7288f93aef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:23:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9f09fa-b82a-436d-a80d-c5e3853d24a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:23:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9f09fa-b82a-436d-a80d-c5e3853d24a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-742406268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a72a289-633e-4b85-bea4-468529da31d7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e634e126c6bb4cf6aa12c84a9da97e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:23:46Z,use_quota=True,user_id='5f761a4d76944b15b1c71fbcc862da2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:23:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc68b75c-29d0-4297-a646-2decf56355b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:23:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc68b75c-29d0-4297-a646-2decf56355b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:23:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d59cf6-f54f-42b7-bf05-4a67c8ac729f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:23:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d59cf6-f54f-42b7-bf05-4a67c8ac729f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a72a289-633e-4b85-bea4-468529da31d7', 'volume_name': 'volume-2a72a289-633e-4b85-bea4-468529da31d7', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:23:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447189f7-830c-44ff-906e-ed6f8c43d70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:23:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447189f7-830c-44ff-906e-ed6f8c43d70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:23:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74f3fd77-76f9-4b30-b28e-84821af81750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:23:46 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Volume 2a72a289-633e-4b85-bea4-468529da31d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a72a289-633e-4b85-bea4-468529da31d7', 'volume_size': 1} Jul 06 15:23:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:23:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:23:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-742406268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a72a289-633e-4b85-bea4-468529da31d7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e634e126c6bb4cf6aa12c84a9da97e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:23:46Z,use_quota=True,user_id='5f761a4d76944b15b1c71fbcc862da2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:23:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Creating volume 2a72a289-633e-4b85-bea4-468529da31d7 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:23:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:23:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:23:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:23:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:23:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:23:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:23:46 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:23:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2a72a289-633e-4b85-bea4-468529da31d7 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:23:46 devstack sudo[86657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2a72a289-633e-4b85-bea4-468529da31d7 1073741824 Jul 06 15:23:46 devstack sudo[86657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:23:47 devstack sudo[86657]: pam_unix(sudo:session): session closed for user root Jul 06 15:23:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2a72a289-633e-4b85-bea4-468529da31d7 1073741824" returned: 0 in 1.274s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:23:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2a72a289-633e-4b85-bea4-468529da31d7 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:23:48 devstack sudo[86976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2a72a289-633e-4b85-bea4-468529da31d7 Jul 06 15:23:48 devstack sudo[86976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:23:49 devstack sudo[86976]: pam_unix(sudo:session): session closed for user root Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2a72a289-633e-4b85-bea4-468529da31d7" returned: 0 in 1.272s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] <== create_volume: return (2665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.672s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74f3fd77-76f9-4b30-b28e-84821af81750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a72a289-633e-4b85-bea4-468529da31d7', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a7cbe61-4f61-4ee5-9805-37feb281c80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:23:49 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Volume volume-2a72a289-633e-4b85-bea4-468529da31d7 (2a72a289-633e-4b85-bea4-468529da31d7): created successfully Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a7cbe61-4f61-4ee5-9805-37feb281c80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Flow 'volume_create_manager' (afe33796-8b86-4d92-86f2-c7288f93aef3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:23:49 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-b1e58d2b-a57b-488c-82a0-20bcf82a908b req-710ab657-a71a-4108-afea-255fa39a09ef tempest-VolumesGetTestJSON-1992837880 None] Created volume successfully. Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Flow 'volume_create_manager' (e4905159-a042-4345-813b-9a4e2acd1a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e59730f0-9aa4-464b-920a-c78f1e8d3c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e59730f0-9aa4-464b-920a-c78f1e8d3c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1467635819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d533c66-33b8-4aa1-9978-72db7367a5a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e5d589319148a893b87d49c803aed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:23:50Z,use_quota=True,user_id='b819dad61cd241278b54e91612b4043c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f72bbc-5383-452e-a3e3-90c1e73c1b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f72bbc-5383-452e-a3e3-90c1e73c1b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee2b6c52-dc93-4a69-8d86-c0a9cf0b0f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee2b6c52-dc93-4a69-8d86-c0a9cf0b0f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d533c66-33b8-4aa1-9978-72db7367a5a9', 'volume_name': 'volume-8d533c66-33b8-4aa1-9978-72db7367a5a9', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c588def7-8c6f-44b1-b684-723d37b7ac55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c588def7-8c6f-44b1-b684-723d37b7ac55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cea17c5-644f-4c90-83cc-01f232be927c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:23:49 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Volume 8d533c66-33b8-4aa1-9978-72db7367a5a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d533c66-33b8-4aa1-9978-72db7367a5a9', 'volume_size': 1} Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1467635819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d533c66-33b8-4aa1-9978-72db7367a5a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e5d589319148a893b87d49c803aed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:23:50Z,use_quota=True,user_id='b819dad61cd241278b54e91612b4043c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Creating volume 8d533c66-33b8-4aa1-9978-72db7367a5a9 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:23:49 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:23:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8d533c66-33b8-4aa1-9978-72db7367a5a9 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:23:49 devstack sudo[86993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8d533c66-33b8-4aa1-9978-72db7367a5a9 1073741824 Jul 06 15:23:49 devstack sudo[86993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:23:50 devstack cinder-volume[86148]: DEBUG cinder.coordination [req-4e8a7ea4-91cb-4032-8bfa-c934c8358868 req-aa875e7b-37c8-4e41-85a4-5da55a4a2b2a tempest-VolumesGetTestJSON-1992837880 None] Acquiring lock "cinder-2a72a289-633e-4b85-bea4-468529da31d7-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:23:50 devstack cinder-volume[86148]: DEBUG cinder.coordination [req-4e8a7ea4-91cb-4032-8bfa-c934c8358868 req-aa875e7b-37c8-4e41-85a4-5da55a4a2b2a tempest-VolumesGetTestJSON-1992837880 None] Lock "cinder-2a72a289-633e-4b85-bea4-468529da31d7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:23:50 devstack cinder-volume[86148]: DEBUG cinder.coordination [req-4e8a7ea4-91cb-4032-8bfa-c934c8358868 req-aa875e7b-37c8-4e41-85a4-5da55a4a2b2a tempest-VolumesGetTestJSON-1992837880 None] Acquiring lock "cinder-quobyte-2a72a289-633e-4b85-bea4-468529da31d7" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:23:50 devstack cinder-volume[86148]: DEBUG cinder.coordination [req-4e8a7ea4-91cb-4032-8bfa-c934c8358868 req-aa875e7b-37c8-4e41-85a4-5da55a4a2b2a tempest-VolumesGetTestJSON-1992837880 None] Lock "cinder-quobyte-2a72a289-633e-4b85-bea4-468529da31d7" acquired by "delete_volume" :: waited 0.035s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:23:50 devstack cinder-volume[86148]: INFO oslo.privsep.daemon [req-4e8a7ea4-91cb-4032-8bfa-c934c8358868 req-aa875e7b-37c8-4e41-85a4-5da55a4a2b2a tempest-VolumesGetTestJSON-1992837880 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp8s58dvq3/privsep.sock'] Jul 06 15:23:50 devstack sudo[86997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp8s58dvq3/privsep.sock Jul 06 15:23:50 devstack sudo[86997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:23:51 devstack sudo[86993]: pam_unix(sudo:session): session closed for user root Jul 06 15:23:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8d533c66-33b8-4aa1-9978-72db7367a5a9 1073741824" returned: 0 in 1.581s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:23:51 devstack cinder-volume[86148]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 06 15:23:51 devstack cinder-volume[86148]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 15:23:51 devstack cinder-volume[86148]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 06 15:23:51 devstack cinder-volume[86148]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 15:23:51 devstack cinder-volume[86148]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 06 15:23:51 devstack cinder-volume[86148]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 06 15:23:51 devstack cinder-volume[86148]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 15:23:51 devstack cinder-volume[86148]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 15:23:51 devstack cinder-volume[86148]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 06 15:23:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8d533c66-33b8-4aa1-9978-72db7367a5a9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:23:51 devstack sudo[87020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8d533c66-33b8-4aa1-9978-72db7367a5a9 Jul 06 15:23:51 devstack sudo[87020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:23:52 devstack cinder-volume[86148]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 06 15:23:52 devstack cinder-volume[86148]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 15:23:52 devstack cinder-volume[86148]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 06 15:23:52 devstack cinder-volume[86148]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 15:23:52 devstack cinder-volume[86148]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 06 15:23:52 devstack cinder-volume[86148]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 06 15:23:52 devstack cinder-volume[86148]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 15:23:52 devstack cinder-volume[86148]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 15:23:52 devstack cinder-volume[86148]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 06 15:23:52 devstack sudo[87020]: pam_unix(sudo:session): session closed for user root Jul 06 15:23:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8d533c66-33b8-4aa1-9978-72db7367a5a9" returned: 0 in 0.990s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:23:52 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] <== create_volume: return (2633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:23:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.638s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:23:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cea17c5-644f-4c90-83cc-01f232be927c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d533c66-33b8-4aa1-9978-72db7367a5a9', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:23:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f10ec249-036f-4881-89a2-bde8044eef65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:23:52 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Volume volume-8d533c66-33b8-4aa1-9978-72db7367a5a9 (8d533c66-33b8-4aa1-9978-72db7367a5a9): created successfully Jul 06 15:23:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f10ec249-036f-4881-89a2-bde8044eef65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:23:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Flow 'volume_create_manager' (e4905159-a042-4345-813b-9a4e2acd1a12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:23:52 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-d581933e-3041-4eb7-9bca-e429fe9251e1 tempest-DeleteServersTestJSON-452695415 None] Created volume successfully. Jul 06 15:23:52 devstack sudo[86997]: pam_unix(sudo:session): session closed for user root Jul 06 15:23:52 devstack cinder-volume[86148]: INFO oslo.privsep.daemon [req-4e8a7ea4-91cb-4032-8bfa-c934c8358868 req-aa875e7b-37c8-4e41-85a4-5da55a4a2b2a tempest-VolumesGetTestJSON-1992837880 None] Spawned new privsep daemon via rootwrap Jul 06 15:23:52 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [req-4e8a7ea4-91cb-4032-8bfa-c934c8358868 req-aa875e7b-37c8-4e41-85a4-5da55a4a2b2a tempest-VolumesGetTestJSON-1992837880 None] Accepted privsep connection to /tmp/tmp8s58dvq3/privsep.sock {{(pid=86148) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 06 15:23:52 devstack cinder-volume[86148]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 06 15:23:52 devstack cinder-volume[86148]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 06 15:23:52 devstack cinder-volume[86148]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 06 15:23:52 devstack cinder-volume[86148]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87025 Jul 06 15:23:52 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[766ac843-a8e2-47f9-b0e8-cfdeef45f2a5]: (2,) {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:23:52 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bd4e28-f1e1-4fab-8791-53c5349530eb]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:23:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-4e8a7ea4-91cb-4032-8bfa-c934c8358868 req-aa875e7b-37c8-4e41-85a4-5da55a4a2b2a tempest-VolumesGetTestJSON-1992837880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2a72a289-633e-4b85-bea4-468529da31d7 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:23:53 devstack sudo[87028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2a72a289-633e-4b85-bea4-468529da31d7 Jul 06 15:23:53 devstack sudo[87028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:23:53 devstack sudo[87028]: pam_unix(sudo:session): session closed for user root Jul 06 15:23:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-4e8a7ea4-91cb-4032-8bfa-c934c8358868 req-aa875e7b-37c8-4e41-85a4-5da55a4a2b2a tempest-VolumesGetTestJSON-1992837880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2a72a289-633e-4b85-bea4-468529da31d7" returned: 0 in 1.090s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:23:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-4e8a7ea4-91cb-4032-8bfa-c934c8358868 req-aa875e7b-37c8-4e41-85a4-5da55a4a2b2a tempest-VolumesGetTestJSON-1992837880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2a72a289-633e-4b85-bea4-468529da31d7 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:23:54 devstack sudo[87044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2a72a289-633e-4b85-bea4-468529da31d7 Jul 06 15:23:54 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:23:54 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root Jul 06 15:23:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-4e8a7ea4-91cb-4032-8bfa-c934c8358868 req-aa875e7b-37c8-4e41-85a4-5da55a4a2b2a tempest-VolumesGetTestJSON-1992837880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2a72a289-633e-4b85-bea4-468529da31d7" returned: 0 in 0.790s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:23:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [req-4e8a7ea4-91cb-4032-8bfa-c934c8358868 req-aa875e7b-37c8-4e41-85a4-5da55a4a2b2a tempest-VolumesGetTestJSON-1992837880 None] Lock "cinder-quobyte-2a72a289-633e-4b85-bea4-468529da31d7" released by "delete_volume" :: held 4.492s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:23:54 devstack cinder-volume[86148]: WARNING cinder.quota [req-4e8a7ea4-91cb-4032-8bfa-c934c8358868 req-aa875e7b-37c8-4e41-85a4-5da55a4a2b2a tempest-VolumesGetTestJSON-1992837880 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:23:54 devstack cinder-volume[86148]: WARNING cinder.quota [req-4e8a7ea4-91cb-4032-8bfa-c934c8358868 req-aa875e7b-37c8-4e41-85a4-5da55a4a2b2a tempest-VolumesGetTestJSON-1992837880 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:23:54 devstack cinder-volume[86148]: DEBUG cinder.quota [req-4e8a7ea4-91cb-4032-8bfa-c934c8358868 req-aa875e7b-37c8-4e41-85a4-5da55a4a2b2a tempest-VolumesGetTestJSON-1992837880 None] Created reservations ['69eba71d-5888-4e1f-b680-403668e28b58', '5dbc5fb5-99f7-4553-9e0c-c9b8ef59b7f3', 'd8fcb53b-86b9-4326-8258-5559e1f502cf', '8f46176e-4f02-4d4d-9db7-ad488a55787d'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:23:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-4e8a7ea4-91cb-4032-8bfa-c934c8358868 req-aa875e7b-37c8-4e41-85a4-5da55a4a2b2a tempest-VolumesGetTestJSON-1992837880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:23:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-4e8a7ea4-91cb-4032-8bfa-c934c8358868 req-aa875e7b-37c8-4e41-85a4-5da55a4a2b2a tempest-VolumesGetTestJSON-1992837880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:23:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [req-4e8a7ea4-91cb-4032-8bfa-c934c8358868 req-aa875e7b-37c8-4e41-85a4-5da55a4a2b2a tempest-VolumesGetTestJSON-1992837880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:23:55 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [req-4e8a7ea4-91cb-4032-8bfa-c934c8358868 req-aa875e7b-37c8-4e41-85a4-5da55a4a2b2a tempest-VolumesGetTestJSON-1992837880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:23:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-4e8a7ea4-91cb-4032-8bfa-c934c8358868 req-aa875e7b-37c8-4e41-85a4-5da55a4a2b2a tempest-VolumesGetTestJSON-1992837880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:23:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-4e8a7ea4-91cb-4032-8bfa-c934c8358868 req-aa875e7b-37c8-4e41-85a4-5da55a4a2b2a tempest-VolumesGetTestJSON-1992837880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:23:55 devstack sudo[87052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:23:55 devstack sudo[87052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:23:56 devstack sudo[87052]: pam_unix(sudo:session): session closed for user root Jul 06 15:23:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-4e8a7ea4-91cb-4032-8bfa-c934c8358868 req-aa875e7b-37c8-4e41-85a4-5da55a4a2b2a tempest-VolumesGetTestJSON-1992837880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.090s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:23:56 devstack cinder-volume[86148]: DEBUG cinder.manager [req-4e8a7ea4-91cb-4032-8bfa-c934c8358868 req-aa875e7b-37c8-4e41-85a4-5da55a4a2b2a tempest-VolumesGetTestJSON-1992837880 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:23:56 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-4e8a7ea4-91cb-4032-8bfa-c934c8358868 req-aa875e7b-37c8-4e41-85a4-5da55a4a2b2a tempest-VolumesGetTestJSON-1992837880 None] Deleted volume successfully. Jul 06 15:23:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [req-4e8a7ea4-91cb-4032-8bfa-c934c8358868 req-aa875e7b-37c8-4e41-85a4-5da55a4a2b2a tempest-VolumesGetTestJSON-1992837880 None] Lock "cinder-2a72a289-633e-4b85-bea4-468529da31d7-delete_volume" released by "delete_volume" :: held 5.942s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:23:59 devstack cinder-volume[86148]: WARNING py.warnings [req-0c515d36-5e49-4aeb-95be-4c9c85c14ec7 req-88adff29-5648-438a-9193-39a3c8747106 tempest-DeleteServersTestJSON-452695415 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 06 15:23:59 devstack cinder-volume[86148]: .first() Jul 06 15:23:59 devstack cinder-volume[86148]: Jul 06 15:23:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-0c515d36-5e49-4aeb-95be-4c9c85c14ec7 req-88adff29-5648-438a-9193-39a3c8747106 tempest-DeleteServersTestJSON-452695415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:23:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-0c515d36-5e49-4aeb-95be-4c9c85c14ec7 req-88adff29-5648-438a-9193-39a3c8747106 tempest-DeleteServersTestJSON-452695415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:23:59 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50c6767-2772-49b4-8462-114748cad9f3]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:23:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-0c515d36-5e49-4aeb-95be-4c9c85c14ec7 req-88adff29-5648-438a-9193-39a3c8747106 tempest-DeleteServersTestJSON-452695415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8d533c66-33b8-4aa1-9978-72db7367a5a9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:23:59 devstack sudo[87129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8d533c66-33b8-4aa1-9978-72db7367a5a9 Jul 06 15:23:59 devstack sudo[87129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:00 devstack sudo[87129]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-0c515d36-5e49-4aeb-95be-4c9c85c14ec7 req-88adff29-5648-438a-9193-39a3c8747106 tempest-DeleteServersTestJSON-452695415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8d533c66-33b8-4aa1-9978-72db7367a5a9" returned: 0 in 1.012s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-0c515d36-5e49-4aeb-95be-4c9c85c14ec7 req-88adff29-5648-438a-9193-39a3c8747106 tempest-DeleteServersTestJSON-452695415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.031s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:24:00 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-0c515d36-5e49-4aeb-95be-4c9c85c14ec7 req-88adff29-5648-438a-9193-39a3c8747106 tempest-DeleteServersTestJSON-452695415 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce', 'name': 'volume-8d533c66-33b8-4aa1-9978-72db7367a5a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '62c66246-2ad8-4a0e-8fd5-d1a8c7c8085d', 'enforce_multipath': True} {{(pid=86148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:24:00 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-0c515d36-5e49-4aeb-95be-4c9c85c14ec7 req-88adff29-5648-438a-9193-39a3c8747106 tempest-DeleteServersTestJSON-452695415 None] attachment_update completed successfully. Jul 06 15:24:04 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-074cead1-4fa2-4880-a358-2341c7acf795 tempest-GroupsTest-1945744537 None] Group tempest-Group1-1639804698: creating Jul 06 15:24:04 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-074cead1-4fa2-4880-a358-2341c7acf795 tempest-GroupsTest-1945744537 None] Group tempest-Group1-1639804698: created successfully Jul 06 15:24:04 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-074cead1-4fa2-4880-a358-2341c7acf795 tempest-GroupsTest-1945744537 None] Create group completed successfully. Jul 06 15:24:06 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-e14004f4-2010-45b7-b9aa-ed9651bfc51d tempest-GroupsTest-1945744537 None] Group tempest-Group2-1031077358: creating Jul 06 15:24:06 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-e14004f4-2010-45b7-b9aa-ed9651bfc51d tempest-GroupsTest-1945744537 None] Group tempest-Group2-1031077358: created successfully Jul 06 15:24:06 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-e14004f4-2010-45b7-b9aa-ed9651bfc51d tempest-GroupsTest-1945744537 None] Create group completed successfully. Jul 06 15:24:08 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:24:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Flow 'volume_create_manager' (782562cd-c0ed-477b-ada5-037e5040aa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:24:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a47c4840-f7b1-46ce-8c8d-7bd9dc59f143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a47c4840-f7b1-46ce-8c8d-7bd9dc59f143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-614779434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d43c236-7203-4b71-b4ac-9057587a111f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75d3d71711014fc3bd0b99f5229ff668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:24:09Z,use_quota=True,user_id='dbc397fc77e94d1eb7a2ac3b646d7d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:24:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (452ad864-31dc-4f77-a597-676986bdfc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (452ad864-31dc-4f77-a597-676986bdfc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:24:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b11a24-625e-4cc5-8244-6bd71d600867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b11a24-625e-4cc5-8244-6bd71d600867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d43c236-7203-4b71-b4ac-9057587a111f', 'volume_name': 'volume-2d43c236-7203-4b71-b4ac-9057587a111f', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:24:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460af867-3058-471c-9eb2-009a1c06d612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460af867-3058-471c-9eb2-009a1c06d612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:24:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ad2f5fd-788d-479a-92d6-bcf895ad2874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:09 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Volume 2d43c236-7203-4b71-b4ac-9057587a111f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d43c236-7203-4b71-b4ac-9057587a111f', 'volume_size': 1} Jul 06 15:24:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:24:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:24:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-614779434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d43c236-7203-4b71-b4ac-9057587a111f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75d3d71711014fc3bd0b99f5229ff668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:24:09Z,use_quota=True,user_id='dbc397fc77e94d1eb7a2ac3b646d7d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:24:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Creating volume 2d43c236-7203-4b71-b4ac-9057587a111f {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:24:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:24:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:24:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:24:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:24:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:24:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:24:09 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:24:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2d43c236-7203-4b71-b4ac-9057587a111f 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:09 devstack sudo[87694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2d43c236-7203-4b71-b4ac-9057587a111f 1073741824 Jul 06 15:24:09 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:09 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:24:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Flow 'volume_create_manager' (d4669545-e3eb-4733-838c-dbb461f28a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:24:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a60ef4-c4b7-4566-8f30-a21949819014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a60ef4-c4b7-4566-8f30-a21949819014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1284961923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b27249d-02b1-428c-8e96-1f90ce1f939b,host='devstack@QuobyteHD#QuobyteHD',id=820e5b01-51e4-41b4-b7bf-c4d4d9158162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c95ffb56b547eab7de07c468fd954c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:24:09Z,use_quota=True,user_id='6de6ac5966dd4e039023db26972e0a92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eea63b85-69c5-4986-ad09-fac425e49b80),volume_type_id=eea63b85-69c5-4986-ad09-fac425e49b80)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:24:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cd90508-55bb-4858-a77a-2620f4908458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cd90508-55bb-4858-a77a-2620f4908458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:24:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc9a87c-de14-49e2-b603-38a4aa33d40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc9a87c-de14-49e2-b603-38a4aa33d40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '820e5b01-51e4-41b4-b7bf-c4d4d9158162', 'volume_name': 'volume-820e5b01-51e4-41b4-b7bf-c4d4d9158162', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:24:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46fcaaa4-f80c-4071-81d6-7fc4925cb43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46fcaaa4-f80c-4071-81d6-7fc4925cb43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:24:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35df84b9-7ee9-4269-bf8a-0d71d47b4a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:09 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Volume 820e5b01-51e4-41b4-b7bf-c4d4d9158162: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-820e5b01-51e4-41b4-b7bf-c4d4d9158162', 'volume_size': 1} Jul 06 15:24:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:24:10 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2d43c236-7203-4b71-b4ac-9057587a111f 1073741824" returned: 0 in 1.373s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2d43c236-7203-4b71-b4ac-9057587a111f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:10 devstack sudo[87706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2d43c236-7203-4b71-b4ac-9057587a111f Jul 06 15:24:10 devstack sudo[87706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:11 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-e614b245-0a49-4a7a-8238-8c27b6983832 req-9a0810e0-827a-4821-b633-d30a5c1a6431 tempest-DeleteServersTestJSON-452695415 None] Terminate volume connection completed successfully. Jul 06 15:24:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-e614b245-0a49-4a7a-8238-8c27b6983832 req-9a0810e0-827a-4821-b633-d30a5c1a6431 tempest-DeleteServersTestJSON-452695415 None] Deleting attachment 62c66246-2ad8-4a0e-8fd5-d1a8c7c8085d. {{(pid=86148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:24:11 devstack sudo[87706]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2d43c236-7203-4b71-b4ac-9057587a111f" returned: 0 in 0.873s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] <== create_volume: return (2298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:24:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.302s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:24:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.808s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:24:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7b27249d-02b1-428c-8e96-1f90ce1f939b,created_at=2026-07-06T13:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1284961923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b27249d-02b1-428c-8e96-1f90ce1f939b,host='devstack@QuobyteHD#QuobyteHD',id=820e5b01-51e4-41b4-b7bf-c4d4d9158162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c95ffb56b547eab7de07c468fd954c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:24:09Z,use_quota=True,user_id='6de6ac5966dd4e039023db26972e0a92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eea63b85-69c5-4986-ad09-fac425e49b80),volume_type_id=eea63b85-69c5-4986-ad09-fac425e49b80)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:24:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Creating volume 820e5b01-51e4-41b4-b7bf-c4d4d9158162 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:24:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:24:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:24:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:24:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:24:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:24:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:24:11 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:24:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-820e5b01-51e4-41b4-b7bf-c4d4d9158162 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:11 devstack sudo[87711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-820e5b01-51e4-41b4-b7bf-c4d4d9158162 1073741824 Jul 06 15:24:11 devstack sudo[87711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ad2f5fd-788d-479a-92d6-bcf895ad2874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d43c236-7203-4b71-b4ac-9057587a111f', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:24:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (290a7850-6f9f-4d47-b208-d736da07509e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:11 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Volume volume-2d43c236-7203-4b71-b4ac-9057587a111f (2d43c236-7203-4b71-b4ac-9057587a111f): created successfully Jul 06 15:24:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (290a7850-6f9f-4d47-b208-d736da07509e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:24:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Flow 'volume_create_manager' (782562cd-c0ed-477b-ada5-037e5040aa72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:24:11 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-27aaed9e-df9d-4545-9347-12b2e659e661 tempest-VolumesAdminNegativeTest-1858998553 None] Created volume successfully. Jul 06 15:24:12 devstack sudo[87711]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-820e5b01-51e4-41b4-b7bf-c4d4d9158162 1073741824" returned: 0 in 1.221s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-820e5b01-51e4-41b4-b7bf-c4d4d9158162 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:12 devstack sudo[87717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-820e5b01-51e4-41b4-b7bf-c4d4d9158162 Jul 06 15:24:12 devstack sudo[87717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:13 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b1d92c6c-530c-48d7-8938-8d84c1918652 tempest-VolumesAdminNegativeTest-1858998553 None] Acquiring lock "cinder-2d43c236-7203-4b71-b4ac-9057587a111f-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:24:13 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b1d92c6c-530c-48d7-8938-8d84c1918652 tempest-VolumesAdminNegativeTest-1858998553 None] Lock "cinder-2d43c236-7203-4b71-b4ac-9057587a111f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:24:13 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b1d92c6c-530c-48d7-8938-8d84c1918652 tempest-VolumesAdminNegativeTest-1858998553 None] Acquiring lock "cinder-quobyte-2d43c236-7203-4b71-b4ac-9057587a111f" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:24:13 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b1d92c6c-530c-48d7-8938-8d84c1918652 tempest-VolumesAdminNegativeTest-1858998553 None] Lock "cinder-quobyte-2d43c236-7203-4b71-b4ac-9057587a111f" acquired by "delete_volume" :: waited 0.027s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:24:13 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[af284c03-8e98-48df-a246-54bf99d2746a]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:24:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b1d92c6c-530c-48d7-8938-8d84c1918652 tempest-VolumesAdminNegativeTest-1858998553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2d43c236-7203-4b71-b4ac-9057587a111f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:13 devstack sudo[87719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2d43c236-7203-4b71-b4ac-9057587a111f Jul 06 15:24:13 devstack sudo[87719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:13 devstack sudo[87717]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-820e5b01-51e4-41b4-b7bf-c4d4d9158162" returned: 0 in 0.856s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:13 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] <== create_volume: return (2219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:24:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.221s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:24:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35df84b9-7ee9-4269-bf8a-0d71d47b4a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-820e5b01-51e4-41b4-b7bf-c4d4d9158162', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:24:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59905fb-ac73-469a-9f6e-50903bb0e718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:13 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Volume volume-820e5b01-51e4-41b4-b7bf-c4d4d9158162 (820e5b01-51e4-41b4-b7bf-c4d4d9158162): created successfully Jul 06 15:24:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59905fb-ac73-469a-9f6e-50903bb0e718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:24:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Flow 'volume_create_manager' (d4669545-e3eb-4733-838c-dbb461f28a2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:24:13 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-7a832805-39db-420b-89c5-1f58349e5802 tempest-GroupsTest-1945744537 None] Created volume successfully. Jul 06 15:24:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b1d92c6c-530c-48d7-8938-8d84c1918652 tempest-VolumesAdminNegativeTest-1858998553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2d43c236-7203-4b71-b4ac-9057587a111f" returned: 0 in 1.209s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b1d92c6c-530c-48d7-8938-8d84c1918652 tempest-VolumesAdminNegativeTest-1858998553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2d43c236-7203-4b71-b4ac-9057587a111f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:14 devstack sudo[87719]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:14 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2d43c236-7203-4b71-b4ac-9057587a111f Jul 06 15:24:14 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:15 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b1d92c6c-530c-48d7-8938-8d84c1918652 tempest-VolumesAdminNegativeTest-1858998553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2d43c236-7203-4b71-b4ac-9057587a111f" returned: 0 in 1.281s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:15 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b1d92c6c-530c-48d7-8938-8d84c1918652 tempest-VolumesAdminNegativeTest-1858998553 None] Lock "cinder-quobyte-2d43c236-7203-4b71-b4ac-9057587a111f" released by "delete_volume" :: held 2.552s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:24:15 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4b81d5e1-4d92-44c7-b592-21943f09cf60 tempest-DeleteServersTestJSON-452695415 None] Acquiring lock "cinder-8d533c66-33b8-4aa1-9978-72db7367a5a9-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:24:15 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4b81d5e1-4d92-44c7-b592-21943f09cf60 tempest-DeleteServersTestJSON-452695415 None] Lock "cinder-8d533c66-33b8-4aa1-9978-72db7367a5a9-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:24:15 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-b1d92c6c-530c-48d7-8938-8d84c1918652 tempest-VolumesAdminNegativeTest-1858998553 None] Created reservations ['fa276cc0-00d4-4961-b00d-23decfe5fa23', '046e72dc-6738-44f5-8da9-86ac5ccc4958', 'effe886e-6bed-4f24-9206-ca115006daef', '1113cf36-ee98-402a-8ed6-fed569721b1c'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:24:16 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4b81d5e1-4d92-44c7-b592-21943f09cf60 tempest-DeleteServersTestJSON-452695415 None] Acquiring lock "cinder-quobyte-8d533c66-33b8-4aa1-9978-72db7367a5a9" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:24:16 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4b81d5e1-4d92-44c7-b592-21943f09cf60 tempest-DeleteServersTestJSON-452695415 None] Lock "cinder-quobyte-8d533c66-33b8-4aa1-9978-72db7367a5a9" acquired by "delete_volume" :: waited 0.057s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:24:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b1d92c6c-530c-48d7-8938-8d84c1918652 tempest-VolumesAdminNegativeTest-1858998553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:24:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b1d92c6c-530c-48d7-8938-8d84c1918652 tempest-VolumesAdminNegativeTest-1858998553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:24:16 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b1d92c6c-530c-48d7-8938-8d84c1918652 tempest-VolumesAdminNegativeTest-1858998553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:24:16 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b1d92c6c-530c-48d7-8938-8d84c1918652 tempest-VolumesAdminNegativeTest-1858998553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:24:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b1d92c6c-530c-48d7-8938-8d84c1918652 tempest-VolumesAdminNegativeTest-1858998553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:24:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b1d92c6c-530c-48d7-8938-8d84c1918652 tempest-VolumesAdminNegativeTest-1858998553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:16 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[638a8d8d-b281-43eb-946f-a0095b39cd20]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:24:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4b81d5e1-4d92-44c7-b592-21943f09cf60 tempest-DeleteServersTestJSON-452695415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8d533c66-33b8-4aa1-9978-72db7367a5a9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:16 devstack sudo[87730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:24:16 devstack sudo[87730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:16 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c761f623-bbb9-4b74-9931-e638ea88320a tempest-GroupsTest-1945744537 None] Acquiring lock "cinder-quobyte-820e5b01-51e4-41b4-b7bf-c4d4d9158162" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:24:16 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c761f623-bbb9-4b74-9931-e638ea88320a tempest-GroupsTest-1945744537 None] Lock "cinder-quobyte-820e5b01-51e4-41b4-b7bf-c4d4d9158162" acquired by "delete_volume" :: waited 0.057s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:24:16 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[029d673f-a031-4535-a93e-cc3fc13a05cb]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:24:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c761f623-bbb9-4b74-9931-e638ea88320a tempest-GroupsTest-1945744537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-820e5b01-51e4-41b4-b7bf-c4d4d9158162 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:16 devstack sudo[87732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8d533c66-33b8-4aa1-9978-72db7367a5a9 Jul 06 15:24:16 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:16 devstack sudo[87733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-820e5b01-51e4-41b4-b7bf-c4d4d9158162 Jul 06 15:24:16 devstack sudo[87733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:17 devstack sudo[87730]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b1d92c6c-530c-48d7-8938-8d84c1918652 tempest-VolumesAdminNegativeTest-1858998553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.608s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:17 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-b1d92c6c-530c-48d7-8938-8d84c1918652 tempest-VolumesAdminNegativeTest-1858998553 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:24:17 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-b1d92c6c-530c-48d7-8938-8d84c1918652 tempest-VolumesAdminNegativeTest-1858998553 None] Deleted volume successfully. Jul 06 15:24:17 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b1d92c6c-530c-48d7-8938-8d84c1918652 tempest-VolumesAdminNegativeTest-1858998553 None] Lock "cinder-2d43c236-7203-4b71-b4ac-9057587a111f-delete_volume" released by "delete_volume" :: held 4.779s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:24:17 devstack sudo[87733]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c761f623-bbb9-4b74-9931-e638ea88320a tempest-GroupsTest-1945744537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-820e5b01-51e4-41b4-b7bf-c4d4d9158162" returned: 0 in 1.536s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c761f623-bbb9-4b74-9931-e638ea88320a tempest-GroupsTest-1945744537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-820e5b01-51e4-41b4-b7bf-c4d4d9158162 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:17 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4b81d5e1-4d92-44c7-b592-21943f09cf60 tempest-DeleteServersTestJSON-452695415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8d533c66-33b8-4aa1-9978-72db7367a5a9" returned: 0 in 1.705s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4b81d5e1-4d92-44c7-b592-21943f09cf60 tempest-DeleteServersTestJSON-452695415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8d533c66-33b8-4aa1-9978-72db7367a5a9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:17 devstack sudo[87768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-820e5b01-51e4-41b4-b7bf-c4d4d9158162 Jul 06 15:24:17 devstack sudo[87768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:17 devstack sudo[87769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8d533c66-33b8-4aa1-9978-72db7367a5a9 Jul 06 15:24:17 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:18 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4b81d5e1-4d92-44c7-b592-21943f09cf60 tempest-DeleteServersTestJSON-452695415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8d533c66-33b8-4aa1-9978-72db7367a5a9" returned: 0 in 0.733s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:18 devstack sudo[87768]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:18 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4b81d5e1-4d92-44c7-b592-21943f09cf60 tempest-DeleteServersTestJSON-452695415 None] Lock "cinder-quobyte-8d533c66-33b8-4aa1-9978-72db7367a5a9" released by "delete_volume" :: held 2.622s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:24:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c761f623-bbb9-4b74-9931-e638ea88320a tempest-GroupsTest-1945744537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-820e5b01-51e4-41b4-b7bf-c4d4d9158162" returned: 0 in 0.867s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:18 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c761f623-bbb9-4b74-9931-e638ea88320a tempest-GroupsTest-1945744537 None] Lock "cinder-quobyte-820e5b01-51e4-41b4-b7bf-c4d4d9158162" released by "delete_volume" :: held 2.496s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:24:18 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-4b81d5e1-4d92-44c7-b592-21943f09cf60 tempest-DeleteServersTestJSON-452695415 None] Created reservations ['7022441f-86ba-4e8f-9348-0ab574a02e5b', '10f7d36d-0421-402e-8513-3d6daa4e1c84', '4892213d-0dde-4843-85c7-dc5d800ae2f4', 'cf4ae402-3435-47d1-bac1-648d444c3780'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:24:18 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-c761f623-bbb9-4b74-9931-e638ea88320a tempest-GroupsTest-1945744537 None] Created reservations ['3825c201-d00a-4cd0-84ea-3d97e75a0573'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:24:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4b81d5e1-4d92-44c7-b592-21943f09cf60 tempest-DeleteServersTestJSON-452695415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:24:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4b81d5e1-4d92-44c7-b592-21943f09cf60 tempest-DeleteServersTestJSON-452695415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:24:19 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4b81d5e1-4d92-44c7-b592-21943f09cf60 tempest-DeleteServersTestJSON-452695415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:24:19 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4b81d5e1-4d92-44c7-b592-21943f09cf60 tempest-DeleteServersTestJSON-452695415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:24:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4b81d5e1-4d92-44c7-b592-21943f09cf60 tempest-DeleteServersTestJSON-452695415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:24:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4b81d5e1-4d92-44c7-b592-21943f09cf60 tempest-DeleteServersTestJSON-452695415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:19 devstack sudo[87792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:24:19 devstack cinder-volume[86148]: WARNING cinder.quota [None req-c761f623-bbb9-4b74-9931-e638ea88320a tempest-GroupsTest-1945744537 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2015142311 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2015142311, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:24:19 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:19 devstack cinder-volume[86148]: WARNING cinder.quota [None req-c761f623-bbb9-4b74-9931-e638ea88320a tempest-GroupsTest-1945744537 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2015142311 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2015142311, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:24:19 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-c761f623-bbb9-4b74-9931-e638ea88320a tempest-GroupsTest-1945744537 None] Created reservations ['29ea7bbb-374f-4287-a96b-dd1a1aeb8bc9', '0bec383f-525b-42d6-b644-7f9782dd1f78', '3da0a5c5-e062-4d5a-81b9-b0574f1eba2d', 'b66bb4a4-a320-42ba-8c31-387d35c384a2'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:24:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c761f623-bbb9-4b74-9931-e638ea88320a tempest-GroupsTest-1945744537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:24:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c761f623-bbb9-4b74-9931-e638ea88320a tempest-GroupsTest-1945744537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:24:19 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c761f623-bbb9-4b74-9931-e638ea88320a tempest-GroupsTest-1945744537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:24:19 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c761f623-bbb9-4b74-9931-e638ea88320a tempest-GroupsTest-1945744537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:24:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c761f623-bbb9-4b74-9931-e638ea88320a tempest-GroupsTest-1945744537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:24:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c761f623-bbb9-4b74-9931-e638ea88320a tempest-GroupsTest-1945744537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:19 devstack sudo[87797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:24:19 devstack sudo[87797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:20 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4b81d5e1-4d92-44c7-b592-21943f09cf60 tempest-DeleteServersTestJSON-452695415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.054s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:20 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-4b81d5e1-4d92-44c7-b592-21943f09cf60 tempest-DeleteServersTestJSON-452695415 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:24:20 devstack sudo[87797]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:20 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-4b81d5e1-4d92-44c7-b592-21943f09cf60 tempest-DeleteServersTestJSON-452695415 None] Deleted volume successfully. Jul 06 15:24:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c761f623-bbb9-4b74-9931-e638ea88320a tempest-GroupsTest-1945744537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.821s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:20 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-c761f623-bbb9-4b74-9931-e638ea88320a tempest-GroupsTest-1945744537 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:24:20 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-c761f623-bbb9-4b74-9931-e638ea88320a tempest-GroupsTest-1945744537 None] Delete group completed successfully. Jul 06 15:24:20 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4b81d5e1-4d92-44c7-b592-21943f09cf60 tempest-DeleteServersTestJSON-452695415 None] Lock "cinder-8d533c66-33b8-4aa1-9978-72db7367a5a9-delete_volume" released by "delete_volume" :: held 4.287s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:24:20 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-a5ce601d-e1fa-4900-8d44-56cad046d256 tempest-GroupsTest-1945744537 None] Created reservations ['0108d753-ea84-465c-9155-1de1a7b7368d'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:24:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a5ce601d-e1fa-4900-8d44-56cad046d256 tempest-GroupsTest-1945744537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:24:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a5ce601d-e1fa-4900-8d44-56cad046d256 tempest-GroupsTest-1945744537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:24:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a5ce601d-e1fa-4900-8d44-56cad046d256 tempest-GroupsTest-1945744537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:24:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a5ce601d-e1fa-4900-8d44-56cad046d256 tempest-GroupsTest-1945744537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:24:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a5ce601d-e1fa-4900-8d44-56cad046d256 tempest-GroupsTest-1945744537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:24:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a5ce601d-e1fa-4900-8d44-56cad046d256 tempest-GroupsTest-1945744537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:20 devstack sudo[87802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:24:20 devstack sudo[87802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:21 devstack sudo[87802]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a5ce601d-e1fa-4900-8d44-56cad046d256 tempest-GroupsTest-1945744537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.715s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:21 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-a5ce601d-e1fa-4900-8d44-56cad046d256 tempest-GroupsTest-1945744537 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:24:21 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a5ce601d-e1fa-4900-8d44-56cad046d256 tempest-GroupsTest-1945744537 None] Delete group completed successfully. Jul 06 15:24:22 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-d3b1a98d-7ca3-469f-a55d-0b9b319a38d4 tempest-GroupsTest-1945744537 None] Group tempest-GroupsTest-Group-1463358510: creating Jul 06 15:24:22 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-d3b1a98d-7ca3-469f-a55d-0b9b319a38d4 tempest-GroupsTest-1945744537 None] Group tempest-GroupsTest-Group-1463358510: created successfully Jul 06 15:24:22 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-d3b1a98d-7ca3-469f-a55d-0b9b319a38d4 tempest-GroupsTest-1945744537 None] Create group completed successfully. Jul 06 15:24:24 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:24:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Flow 'volume_create_manager' (b85ada19-50b4-4a6e-9e83-db65d723e795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:24:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e28ed460-79d0-4c1d-a771-2817ef0cbdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e28ed460-79d0-4c1d-a771-2817ef0cbdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1970773239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=19b54010-2b34-4f05-85e7-4cc90cb69bd1,host='devstack@QuobyteHD#QuobyteHD',id=7bccc75a-7fcd-4ce0-8dad-1d770be38d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c95ffb56b547eab7de07c468fd954c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:24:24Z,use_quota=True,user_id='6de6ac5966dd4e039023db26972e0a92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eaad7f9c-572c-4950-91d3-7f7d86252931),volume_type_id=eaad7f9c-572c-4950-91d3-7f7d86252931)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:24:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (753a9857-66ce-45db-9549-07f0f7962a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (753a9857-66ce-45db-9549-07f0f7962a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:24:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289778c5-fd5d-4b00-af40-d725451b6592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289778c5-fd5d-4b00-af40-d725451b6592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bccc75a-7fcd-4ce0-8dad-1d770be38d45', 'volume_name': 'volume-7bccc75a-7fcd-4ce0-8dad-1d770be38d45', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:24:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9990640-10ec-4629-b151-0678b9de2910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9990640-10ec-4629-b151-0678b9de2910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:24:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02d47c3-d63d-4301-96f8-238af3e0dbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:24 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Volume 7bccc75a-7fcd-4ce0-8dad-1d770be38d45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bccc75a-7fcd-4ce0-8dad-1d770be38d45', 'volume_size': 1} Jul 06 15:24:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:24:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:24:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=19b54010-2b34-4f05-85e7-4cc90cb69bd1,created_at=2026-07-06T13:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1970773239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=19b54010-2b34-4f05-85e7-4cc90cb69bd1,host='devstack@QuobyteHD#QuobyteHD',id=7bccc75a-7fcd-4ce0-8dad-1d770be38d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c95ffb56b547eab7de07c468fd954c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:24:24Z,use_quota=True,user_id='6de6ac5966dd4e039023db26972e0a92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eaad7f9c-572c-4950-91d3-7f7d86252931),volume_type_id=eaad7f9c-572c-4950-91d3-7f7d86252931)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:24:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Creating volume 7bccc75a-7fcd-4ce0-8dad-1d770be38d45 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:24:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:24:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:24:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:24:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:24:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:24:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:24:24 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:24:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7bccc75a-7fcd-4ce0-8dad-1d770be38d45 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:24 devstack sudo[87810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7bccc75a-7fcd-4ce0-8dad-1d770be38d45 1073741824 Jul 06 15:24:24 devstack sudo[87810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:25 devstack sudo[87810]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7bccc75a-7fcd-4ce0-8dad-1d770be38d45 1073741824" returned: 0 in 0.943s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7bccc75a-7fcd-4ce0-8dad-1d770be38d45 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:25 devstack sudo[87821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7bccc75a-7fcd-4ce0-8dad-1d770be38d45 Jul 06 15:24:25 devstack sudo[87821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:26 devstack sudo[87821]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7bccc75a-7fcd-4ce0-8dad-1d770be38d45" returned: 0 in 0.999s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:26 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] <== create_volume: return (2003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:24:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:24:26 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02d47c3-d63d-4301-96f8-238af3e0dbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bccc75a-7fcd-4ce0-8dad-1d770be38d45', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:24:26 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce81e83c-fde9-4bad-87ac-9c5cc8abb66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:26 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Volume volume-7bccc75a-7fcd-4ce0-8dad-1d770be38d45 (7bccc75a-7fcd-4ce0-8dad-1d770be38d45): created successfully Jul 06 15:24:26 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce81e83c-fde9-4bad-87ac-9c5cc8abb66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:24:26 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Flow 'volume_create_manager' (b85ada19-50b4-4a6e-9e83-db65d723e795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:24:26 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-e70053e6-399e-4b13-82c2-215c839981ad tempest-GroupsTest-1945744537 None] Created volume successfully. Jul 06 15:24:27 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:24:27 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Flow 'volume_create_manager' (d3495fdf-37a9-4bbf-86e9-544da4054f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:24:27 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1461247e-0eed-44b6-8b73-b9be724f050e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:27 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1461247e-0eed-44b6-8b73-b9be724f050e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-779702997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=19b54010-2b34-4f05-85e7-4cc90cb69bd1,host='devstack@QuobyteHD#QuobyteHD',id=a5416671-aef1-4a6a-ab10-9406156a89bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c95ffb56b547eab7de07c468fd954c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:24:27Z,use_quota=True,user_id='6de6ac5966dd4e039023db26972e0a92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eaad7f9c-572c-4950-91d3-7f7d86252931),volume_type_id=eaad7f9c-572c-4950-91d3-7f7d86252931)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:24:27 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b275b3-c907-4f59-ae19-2ea86d4ba95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:27 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b275b3-c907-4f59-ae19-2ea86d4ba95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:24:27 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f5d98df-02c1-4624-9f8f-f7b57cce138a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:27 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f5d98df-02c1-4624-9f8f-f7b57cce138a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5416671-aef1-4a6a-ab10-9406156a89bb', 'volume_name': 'volume-a5416671-aef1-4a6a-ab10-9406156a89bb', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:24:27 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc93b60-e73f-4dbf-8dcd-b72892350078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:27 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc93b60-e73f-4dbf-8dcd-b72892350078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:24:27 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c84ba81-82a9-40e4-97b2-0d6578f69baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:27 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Volume a5416671-aef1-4a6a-ab10-9406156a89bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5416671-aef1-4a6a-ab10-9406156a89bb', 'volume_size': 1} Jul 06 15:24:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:24:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:24:27 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=19b54010-2b34-4f05-85e7-4cc90cb69bd1,created_at=2026-07-06T13:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-779702997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=19b54010-2b34-4f05-85e7-4cc90cb69bd1,host='devstack@QuobyteHD#QuobyteHD',id=a5416671-aef1-4a6a-ab10-9406156a89bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c95ffb56b547eab7de07c468fd954c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:24:27Z,use_quota=True,user_id='6de6ac5966dd4e039023db26972e0a92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eaad7f9c-572c-4950-91d3-7f7d86252931),volume_type_id=eaad7f9c-572c-4950-91d3-7f7d86252931)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:24:27 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Creating volume a5416671-aef1-4a6a-ab10-9406156a89bb {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:24:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:24:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:24:27 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:24:27 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:24:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:24:27 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:24:27 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:24:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a5416671-aef1-4a6a-ab10-9406156a89bb 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:27 devstack sudo[87868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a5416671-aef1-4a6a-ab10-9406156a89bb 1073741824 Jul 06 15:24:27 devstack sudo[87868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:28 devstack sudo[87868]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a5416671-aef1-4a6a-ab10-9406156a89bb 1073741824" returned: 0 in 1.099s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a5416671-aef1-4a6a-ab10-9406156a89bb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:29 devstack sudo[87879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a5416671-aef1-4a6a-ab10-9406156a89bb Jul 06 15:24:29 devstack sudo[87879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:29 devstack sudo[87879]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a5416671-aef1-4a6a-ab10-9406156a89bb" returned: 0 in 0.870s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:29 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] <== create_volume: return (2046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:24:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.048s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:24:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c84ba81-82a9-40e4-97b2-0d6578f69baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5416671-aef1-4a6a-ab10-9406156a89bb', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:24:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d1c1e6-0f3e-473a-a223-901d546c2c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:29 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Volume volume-a5416671-aef1-4a6a-ab10-9406156a89bb (a5416671-aef1-4a6a-ab10-9406156a89bb): created successfully Jul 06 15:24:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d1c1e6-0f3e-473a-a223-901d546c2c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:24:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Flow 'volume_create_manager' (d3495fdf-37a9-4bbf-86e9-544da4054f7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:24:29 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-294b9924-22aa-474c-a9c2-cc239c3aa5ac tempest-GroupsTest-1945744537 None] Created volume successfully. Jul 06 15:24:31 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-9d82081f-4f3d-4d7b-8f50-e4720f77c54b tempest-GroupsTest-1945744537 None] Update group completed successfully. Jul 06 15:24:32 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-e87ad898-ddf5-4cf7-8e29-ff37994b9d87 tempest-GroupsTest-1945744537 None] Update group completed successfully. Jul 06 15:24:34 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-87cb7bc4-70a7-4aa5-bcac-99a54070c652 tempest-GroupsTest-1945744537 None] Acquiring lock "cinder-quobyte-7bccc75a-7fcd-4ce0-8dad-1d770be38d45" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:24:34 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-87cb7bc4-70a7-4aa5-bcac-99a54070c652 tempest-GroupsTest-1945744537 None] Lock "cinder-quobyte-7bccc75a-7fcd-4ce0-8dad-1d770be38d45" acquired by "delete_volume" :: waited 0.024s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:24:35 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b6608a-b395-4ae0-a9c3-a12919c90361]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:24:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-87cb7bc4-70a7-4aa5-bcac-99a54070c652 tempest-GroupsTest-1945744537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7bccc75a-7fcd-4ce0-8dad-1d770be38d45 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:35 devstack sudo[87922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7bccc75a-7fcd-4ce0-8dad-1d770be38d45 Jul 06 15:24:35 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:35 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-87cb7bc4-70a7-4aa5-bcac-99a54070c652 tempest-GroupsTest-1945744537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7bccc75a-7fcd-4ce0-8dad-1d770be38d45" returned: 0 in 0.838s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-87cb7bc4-70a7-4aa5-bcac-99a54070c652 tempest-GroupsTest-1945744537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7bccc75a-7fcd-4ce0-8dad-1d770be38d45 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:35 devstack sudo[87927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7bccc75a-7fcd-4ce0-8dad-1d770be38d45 Jul 06 15:24:35 devstack sudo[87927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:36 devstack sudo[87927]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-87cb7bc4-70a7-4aa5-bcac-99a54070c652 tempest-GroupsTest-1945744537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7bccc75a-7fcd-4ce0-8dad-1d770be38d45" returned: 0 in 0.681s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-87cb7bc4-70a7-4aa5-bcac-99a54070c652 tempest-GroupsTest-1945744537 None] Lock "cinder-quobyte-7bccc75a-7fcd-4ce0-8dad-1d770be38d45" released by "delete_volume" :: held 1.616s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:24:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-87cb7bc4-70a7-4aa5-bcac-99a54070c652 tempest-GroupsTest-1945744537 None] Acquiring lock "cinder-quobyte-a5416671-aef1-4a6a-ab10-9406156a89bb" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:24:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-87cb7bc4-70a7-4aa5-bcac-99a54070c652 tempest-GroupsTest-1945744537 None] Lock "cinder-quobyte-a5416671-aef1-4a6a-ab10-9406156a89bb" acquired by "delete_volume" :: waited 0.022s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:24:36 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[c985f1aa-a7d9-440a-8a63-8d97bba6bf69]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:24:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-87cb7bc4-70a7-4aa5-bcac-99a54070c652 tempest-GroupsTest-1945744537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a5416671-aef1-4a6a-ab10-9406156a89bb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:36 devstack sudo[87930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a5416671-aef1-4a6a-ab10-9406156a89bb Jul 06 15:24:36 devstack sudo[87930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:37 devstack sudo[87930]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-87cb7bc4-70a7-4aa5-bcac-99a54070c652 tempest-GroupsTest-1945744537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a5416671-aef1-4a6a-ab10-9406156a89bb" returned: 0 in 0.934s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-87cb7bc4-70a7-4aa5-bcac-99a54070c652 tempest-GroupsTest-1945744537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a5416671-aef1-4a6a-ab10-9406156a89bb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:37 devstack sudo[87937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a5416671-aef1-4a6a-ab10-9406156a89bb Jul 06 15:24:37 devstack sudo[87937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:38 devstack sudo[87937]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-87cb7bc4-70a7-4aa5-bcac-99a54070c652 tempest-GroupsTest-1945744537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a5416671-aef1-4a6a-ab10-9406156a89bb" returned: 0 in 0.829s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:24:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:24:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:24:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:24:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:24:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:24:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-87cb7bc4-70a7-4aa5-bcac-99a54070c652 tempest-GroupsTest-1945744537 None] Lock "cinder-quobyte-a5416671-aef1-4a6a-ab10-9406156a89bb" released by "delete_volume" :: held 1.842s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:24:38 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=66,cinder:UPDATE=58,cinder:INSERT=12,cinder:DELETE=3 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:24:38 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:UPDATE=66,cinder:SELECT=48,cinder:INSERT=12,cinder:DELETE=6 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:24:38 devstack sudo[87941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:24:38 devstack sudo[87941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:38 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-87cb7bc4-70a7-4aa5-bcac-99a54070c652 tempest-GroupsTest-1945744537 None] Created reservations ['ecb2c8b0-a184-40e0-a071-31eb41e4ed2b'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:24:38 devstack cinder-volume[86148]: WARNING cinder.quota [None req-87cb7bc4-70a7-4aa5-bcac-99a54070c652 tempest-GroupsTest-1945744537 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-730390726 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-730390726, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:24:38 devstack cinder-volume[86148]: WARNING cinder.quota [None req-87cb7bc4-70a7-4aa5-bcac-99a54070c652 tempest-GroupsTest-1945744537 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-730390726 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-730390726, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:24:38 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-87cb7bc4-70a7-4aa5-bcac-99a54070c652 tempest-GroupsTest-1945744537 None] Created reservations ['7eb6192b-6f40-4e1f-b433-3f240e699c1a', 'e1422cac-c64f-491b-bf2a-2e2ab12528ff', 'b3eeee70-215f-4f5d-979e-011b600ec8bc', '8c3af08e-463e-45d0-99c9-d4f8db15f54b'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:24:38 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-87cb7bc4-70a7-4aa5-bcac-99a54070c652 tempest-GroupsTest-1945744537 None] Created reservations ['985369a5-5e70-485b-a7c4-2429199d90d0', '441341cf-2144-4c0b-aacd-76972d26aea9', 'ef11bf5c-e95b-4f14-81c0-50e81d7983f6', '9c775e03-8654-464d-ac00-76f09f7e26ad'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:24:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-87cb7bc4-70a7-4aa5-bcac-99a54070c652 tempest-GroupsTest-1945744537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:24:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-87cb7bc4-70a7-4aa5-bcac-99a54070c652 tempest-GroupsTest-1945744537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:24:39 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-87cb7bc4-70a7-4aa5-bcac-99a54070c652 tempest-GroupsTest-1945744537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:24:39 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-87cb7bc4-70a7-4aa5-bcac-99a54070c652 tempest-GroupsTest-1945744537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:24:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-87cb7bc4-70a7-4aa5-bcac-99a54070c652 tempest-GroupsTest-1945744537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:24:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-87cb7bc4-70a7-4aa5-bcac-99a54070c652 tempest-GroupsTest-1945744537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:39 devstack sudo[87944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:24:39 devstack sudo[87944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:39 devstack sudo[87941]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.135s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:24:39 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager._thread_info {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:24:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread count: 8 {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:24:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread info: [<_MainThread(MainThread, started 124857273856128)>, , , , , , , ] {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:24:40 devstack sudo[87944]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-87cb7bc4-70a7-4aa5-bcac-99a54070c652 tempest-GroupsTest-1945744537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.874s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:40 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-87cb7bc4-70a7-4aa5-bcac-99a54070c652 tempest-GroupsTest-1945744537 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:24:40 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-87cb7bc4-70a7-4aa5-bcac-99a54070c652 tempest-GroupsTest-1945744537 None] Delete group completed successfully. Jul 06 15:24:58 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=13,cinder:INSERT=5,cinder:UPDATE=18 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:24:58 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=11,cinder:UPDATE=19,cinder:INSERT=4 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:24:59 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:24:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Flow 'volume_create_manager' (c9153dbb-e7d2-44e3-94bd-b3295a20e323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:24:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ead017e-7a57-4b83-8869-05845ee933cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ead017e-7a57-4b83-8869-05845ee933cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1014015643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d022dff-f14c-490f-ab18-6470a43d7a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db48d58e1c114589a8dade46a23dfe38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:24:59Z,use_quota=True,user_id='d2130b44f7e44bdc931a6e06b8101c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:24:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bff3f503-04a0-418b-b0db-862c90fe764c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bff3f503-04a0-418b-b0db-862c90fe764c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:24:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63358fb3-b701-4c38-9dac-1f32c980a8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63358fb3-b701-4c38-9dac-1f32c980a8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d022dff-f14c-490f-ab18-6470a43d7a4b', 'volume_name': 'volume-1d022dff-f14c-490f-ab18-6470a43d7a4b', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:24:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38118f36-75af-42c4-b680-0dc38560c5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38118f36-75af-42c4-b680-0dc38560c5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:24:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb7efe4-eed2-490a-a116-16d2d0616652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:24:59 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Volume 1d022dff-f14c-490f-ab18-6470a43d7a4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d022dff-f14c-490f-ab18-6470a43d7a4b', 'volume_size': 1} Jul 06 15:24:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:24:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:24:59 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1014015643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d022dff-f14c-490f-ab18-6470a43d7a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db48d58e1c114589a8dade46a23dfe38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:24:59Z,use_quota=True,user_id='d2130b44f7e44bdc931a6e06b8101c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:24:59 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Creating volume 1d022dff-f14c-490f-ab18-6470a43d7a4b {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:24:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:24:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:24:59 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:24:59 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:24:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:24:59 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:24:59 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:24:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1d022dff-f14c-490f-ab18-6470a43d7a4b 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:59 devstack sudo[88074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1d022dff-f14c-490f-ab18-6470a43d7a4b 1073741824 Jul 06 15:24:59 devstack sudo[88074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:00 devstack sudo[88074]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1d022dff-f14c-490f-ab18-6470a43d7a4b 1073741824" returned: 0 in 1.135s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1d022dff-f14c-490f-ab18-6470a43d7a4b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:00 devstack sudo[88081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1d022dff-f14c-490f-ab18-6470a43d7a4b Jul 06 15:25:00 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:02 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1d022dff-f14c-490f-ab18-6470a43d7a4b" returned: 0 in 1.579s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] <== create_volume: return (2774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.778s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb7efe4-eed2-490a-a116-16d2d0616652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d022dff-f14c-490f-ab18-6470a43d7a4b', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bed794d-6235-4549-8f54-31f54e102360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:25:02 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Volume volume-1d022dff-f14c-490f-ab18-6470a43d7a4b (1d022dff-f14c-490f-ab18-6470a43d7a4b): created successfully Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bed794d-6235-4549-8f54-31f54e102360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Flow 'volume_create_manager' (c9153dbb-e7d2-44e3-94bd-b3295a20e323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:25:02 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-bf2ce28d-9038-4019-a500-d1491bddbce4 tempest-TaggedAttachmentsTest-1741614252 None] Created volume successfully. Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Flow 'volume_create_manager' (e2802844-7fc1-4aff-8b97-a08be6fb1605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (900953e9-c73b-4e24-b08b-92cdf1a10724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (900953e9-c73b-4e24-b08b-92cdf1a10724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-857997422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8809a9d0e3f54cb2b40645236eb54baf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:25:02Z,use_quota=True,user_id='cb85ce8598b344f58ead51b209a2e5a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61244cd7-4850-4e13-adac-67a416792578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61244cd7-4850-4e13-adac-67a416792578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da53ff89-6b00-4fbf-8b8c-fd6e7e8fc8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da53ff89-6b00-4fbf-8b8c-fd6e7e8fc8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8', 'volume_name': 'volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c95d9c-eb28-4eb5-bd02-d0a838ab270b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c95d9c-eb28-4eb5-bd02-d0a838ab270b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae9636f1-8973-454c-b070-051475dc8a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:25:02 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Volume 4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8', 'volume_size': 1} Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-857997422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8809a9d0e3f54cb2b40645236eb54baf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:25:02Z,use_quota=True,user_id='cb85ce8598b344f58ead51b209a2e5a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Creating volume 4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:25:02 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:25:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:02 devstack sudo[88092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8 1073741824 Jul 06 15:25:02 devstack sudo[88092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:04 devstack sudo[88092]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8 1073741824" returned: 0 in 1.724s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:04 devstack sudo[88389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8 Jul 06 15:25:04 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:05 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8" returned: 0 in 0.859s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:05 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] <== create_volume: return (2668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:25:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.677s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:25:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae9636f1-8973-454c-b070-051475dc8a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:25:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c36c5b-e2ba-4bdb-a393-fe20ed5f4c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:25:05 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Volume volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8 (4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8): created successfully Jul 06 15:25:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c36c5b-e2ba-4bdb-a393-fe20ed5f4c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:25:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Flow 'volume_create_manager' (e2802844-7fc1-4aff-8b97-a08be6fb1605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:25:05 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-6e583f0a-47d1-4428-8c90-c339ac3cadbc tempest-SnapshotsActionsTest-572684038 None] Created volume successfully. Jul 06 15:25:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bee34bd3-2c97-4065-a9f4-c4ce6a0089f2 tempest-SnapshotsActionsTest-572684038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:25:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bee34bd3-2c97-4065-a9f4-c4ce6a0089f2 tempest-SnapshotsActionsTest-572684038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:25:06 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-bee34bd3-2c97-4065-a9f4-c4ce6a0089f2 tempest-SnapshotsActionsTest-572684038 None] Creating offline snapshot fc395685-2796-4791-880d-5b91d27d7081 of volume 4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:25:06 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89dce9b-04ba-44d2-97d6-dbfb12e1604b]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:25:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bee34bd3-2c97-4065-a9f4-c4ce6a0089f2 tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:07 devstack sudo[88461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8 Jul 06 15:25:07 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:08 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bee34bd3-2c97-4065-a9f4-c4ce6a0089f2 tempest-SnapshotsActionsTest-572684038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8" returned: 0 in 1.118s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bee34bd3-2c97-4065-a9f4-c4ce6a0089f2 tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:08 devstack sudo[88468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 1G Jul 06 15:25:08 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:09 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bee34bd3-2c97-4065-a9f4-c4ce6a0089f2 tempest-SnapshotsActionsTest-572684038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 1G" returned: 0 in 1.074s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bee34bd3-2c97-4065-a9f4-c4ce6a0089f2 tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:09 devstack sudo[88478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 Jul 06 15:25:09 devstack sudo[88478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:10 devstack sudo[88478]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bee34bd3-2c97-4065-a9f4-c4ce6a0089f2 tempest-SnapshotsActionsTest-572684038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081" returned: 0 in 1.244s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:10 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-bee34bd3-2c97-4065-a9f4-c4ce6a0089f2 tempest-SnapshotsActionsTest-572684038 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 is being set with open permissions: ugo+rw Jul 06 15:25:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bee34bd3-2c97-4065-a9f4-c4ce6a0089f2 tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:10 devstack sudo[88504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 Jul 06 15:25:10 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:11 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bee34bd3-2c97-4065-a9f4-c4ce6a0089f2 tempest-SnapshotsActionsTest-572684038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081" returned: 0 in 1.034s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bee34bd3-2c97-4065-a9f4-c4ce6a0089f2 tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:11 devstack sudo[88579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.info Jul 06 15:25:11 devstack sudo[88579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:12 devstack sudo[88579]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bee34bd3-2c97-4065-a9f4-c4ce6a0089f2 tempest-SnapshotsActionsTest-572684038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.info" returned: 0 in 0.980s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:12 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-bee34bd3-2c97-4065-a9f4-c4ce6a0089f2 tempest-SnapshotsActionsTest-572684038 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.info is being set with open permissions: ugo+rw Jul 06 15:25:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bee34bd3-2c97-4065-a9f4-c4ce6a0089f2 tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:12 devstack sudo[88591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.info Jul 06 15:25:12 devstack sudo[88591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:13 devstack sudo[88591]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bee34bd3-2c97-4065-a9f4-c4ce6a0089f2 tempest-SnapshotsActionsTest-572684038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.info" returned: 0 in 0.686s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bee34bd3-2c97-4065-a9f4-c4ce6a0089f2 tempest-SnapshotsActionsTest-572684038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.282s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:25:13 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-bee34bd3-2c97-4065-a9f4-c4ce6a0089f2 tempest-SnapshotsActionsTest-572684038 None] Create snapshot completed successfully Jul 06 15:25:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ce29f3f5-db2f-4ce2-9723-9e1c27d9752d tempest-SnapshotsActionsTest-572684038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:25:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ce29f3f5-db2f-4ce2-9723-9e1c27d9752d tempest-SnapshotsActionsTest-572684038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:25:13 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-ce29f3f5-db2f-4ce2-9723-9e1c27d9752d tempest-SnapshotsActionsTest-572684038 None] Creating offline snapshot a76c0e64-9ebd-4e20-b3ff-695acd646886 of volume 4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:25:14 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[175a2c13-b3f2-40bb-ac84-ed0c188a8994]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:25:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ce29f3f5-db2f-4ce2-9723-9e1c27d9752d tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:14 devstack sudo[88594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 Jul 06 15:25:14 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:14 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ce29f3f5-db2f-4ce2-9723-9e1c27d9752d tempest-SnapshotsActionsTest-572684038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081" returned: 0 in 0.813s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-ce29f3f5-db2f-4ce2-9723-9e1c27d9752d tempest-SnapshotsActionsTest-572684038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:25:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ce29f3f5-db2f-4ce2-9723-9e1c27d9752d tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.a76c0e64-9ebd-4e20-b3ff-695acd646886 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:14 devstack sudo[88603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.a76c0e64-9ebd-4e20-b3ff-695acd646886 1G Jul 06 15:25:14 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:15 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ce29f3f5-db2f-4ce2-9723-9e1c27d9752d tempest-SnapshotsActionsTest-572684038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.a76c0e64-9ebd-4e20-b3ff-695acd646886 1G" returned: 0 in 1.059s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ce29f3f5-db2f-4ce2-9723-9e1c27d9752d tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.a76c0e64-9ebd-4e20-b3ff-695acd646886 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:15 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.a76c0e64-9ebd-4e20-b3ff-695acd646886 Jul 06 15:25:15 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:16 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ce29f3f5-db2f-4ce2-9723-9e1c27d9752d tempest-SnapshotsActionsTest-572684038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.a76c0e64-9ebd-4e20-b3ff-695acd646886" returned: 0 in 1.076s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:16 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-ce29f3f5-db2f-4ce2-9723-9e1c27d9752d tempest-SnapshotsActionsTest-572684038 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.a76c0e64-9ebd-4e20-b3ff-695acd646886 is being set with open permissions: ugo+rw Jul 06 15:25:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ce29f3f5-db2f-4ce2-9723-9e1c27d9752d tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.a76c0e64-9ebd-4e20-b3ff-695acd646886 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:16 devstack sudo[88641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.a76c0e64-9ebd-4e20-b3ff-695acd646886 Jul 06 15:25:16 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:18 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ce29f3f5-db2f-4ce2-9723-9e1c27d9752d tempest-SnapshotsActionsTest-572684038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.a76c0e64-9ebd-4e20-b3ff-695acd646886" returned: 0 in 1.107s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ce29f3f5-db2f-4ce2-9723-9e1c27d9752d tempest-SnapshotsActionsTest-572684038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.211s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:25:18 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-ce29f3f5-db2f-4ce2-9723-9e1c27d9752d tempest-SnapshotsActionsTest-572684038 None] Create snapshot completed successfully Jul 06 15:25:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5eca5817-73d8-482a-a998-77c443248e04 tempest-SnapshotsActionsTest-2022497539 None] Acquiring lock "cinder-a76c0e64-9ebd-4e20-b3ff-695acd646886-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:25:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5eca5817-73d8-482a-a998-77c443248e04 tempest-SnapshotsActionsTest-2022497539 None] Lock "cinder-a76c0e64-9ebd-4e20-b3ff-695acd646886-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:25:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5eca5817-73d8-482a-a998-77c443248e04 tempest-SnapshotsActionsTest-2022497539 None] Acquiring lock "cinder-quobyte-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:25:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5eca5817-73d8-482a-a998-77c443248e04 tempest-SnapshotsActionsTest-2022497539 None] Lock "cinder-quobyte-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:25:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5eca5817-73d8-482a-a998-77c443248e04 tempest-SnapshotsActionsTest-2022497539 None] Acquiring lock "cinder-quobyte-a76c0e64-9ebd-4e20-b3ff-695acd646886" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:25:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5eca5817-73d8-482a-a998-77c443248e04 tempest-SnapshotsActionsTest-2022497539 None] Lock "cinder-quobyte-a76c0e64-9ebd-4e20-b3ff-695acd646886" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:25:19 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-5eca5817-73d8-482a-a998-77c443248e04 tempest-SnapshotsActionsTest-2022497539 None] Deleting offline snapshot a76c0e64-9ebd-4e20-b3ff-695acd646886 of volume 4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:25:19 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-5eca5817-73d8-482a-a998-77c443248e04 tempest-SnapshotsActionsTest-2022497539 None] snapshot_file for this snap is: volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.a76c0e64-9ebd-4e20-b3ff-695acd646886 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:25:19 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[0992d531-db0f-4f97-a4b0-1344b5ca0c3c]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:25:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5eca5817-73d8-482a-a998-77c443248e04 tempest-SnapshotsActionsTest-2022497539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.a76c0e64-9ebd-4e20-b3ff-695acd646886 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:19 devstack sudo[88665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.a76c0e64-9ebd-4e20-b3ff-695acd646886 Jul 06 15:25:19 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:20 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:25:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Flow 'volume_create_manager' (dde7faec-614a-4ac7-91af-20adcaaaad92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:25:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1094e0c-41bf-405e-b157-be9b71d01203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:25:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1094e0c-41bf-405e-b157-be9b71d01203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-248141289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce48d0cc-2eec-4f7e-b10f-60ed321ceff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfa76099ed614690bb78e06f2f986c31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:25:21Z,use_quota=True,user_id='0be5ec81de0648bb9cd5d79b9dee528d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:25:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c404d7d8-fc4d-4c24-b946-33ee5bc4990d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:25:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c404d7d8-fc4d-4c24-b946-33ee5bc4990d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:25:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39dc2d80-e708-4df9-b59c-621178247604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:25:20 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39dc2d80-e708-4df9-b59c-621178247604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce48d0cc-2eec-4f7e-b10f-60ed321ceff3', 'volume_name': 'volume-ce48d0cc-2eec-4f7e-b10f-60ed321ceff3', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:25:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69d65c94-8a83-476f-97de-d6d9b08aad59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:25:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69d65c94-8a83-476f-97de-d6d9b08aad59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:25:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d238bcf0-3d80-4451-a1fb-0fbd1d9e3a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:25:20 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Volume ce48d0cc-2eec-4f7e-b10f-60ed321ceff3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce48d0cc-2eec-4f7e-b10f-60ed321ceff3', 'volume_size': 1} Jul 06 15:25:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:25:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:25:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-248141289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce48d0cc-2eec-4f7e-b10f-60ed321ceff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfa76099ed614690bb78e06f2f986c31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:25:21Z,use_quota=True,user_id='0be5ec81de0648bb9cd5d79b9dee528d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:25:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Creating volume ce48d0cc-2eec-4f7e-b10f-60ed321ceff3 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:25:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:25:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:25:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:25:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:25:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:25:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:25:20 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:25:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ce48d0cc-2eec-4f7e-b10f-60ed321ceff3 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5eca5817-73d8-482a-a998-77c443248e04 tempest-SnapshotsActionsTest-2022497539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.a76c0e64-9ebd-4e20-b3ff-695acd646886" returned: 0 in 1.216s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-5eca5817-73d8-482a-a998-77c443248e04 tempest-SnapshotsActionsTest-2022497539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:25:20 devstack sudo[88675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ce48d0cc-2eec-4f7e-b10f-60ed321ceff3 1073741824 Jul 06 15:25:20 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:20 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[896deaf2-a55a-46af-8fc8-e47ea73558d3]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:25:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5eca5817-73d8-482a-a998-77c443248e04 tempest-SnapshotsActionsTest-2022497539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:21 devstack sudo[88677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 Jul 06 15:25:21 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:22 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5eca5817-73d8-482a-a998-77c443248e04 tempest-SnapshotsActionsTest-2022497539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081" returned: 0 in 1.057s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:22 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:22 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-5eca5817-73d8-482a-a998-77c443248e04 tempest-SnapshotsActionsTest-2022497539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:25:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5eca5817-73d8-482a-a998-77c443248e04 tempest-SnapshotsActionsTest-2022497539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.a76c0e64-9ebd-4e20-b3ff-695acd646886 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ce48d0cc-2eec-4f7e-b10f-60ed321ceff3 1073741824" returned: 0 in 1.132s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:22 devstack sudo[88703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.a76c0e64-9ebd-4e20-b3ff-695acd646886 Jul 06 15:25:22 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ce48d0cc-2eec-4f7e-b10f-60ed321ceff3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:22 devstack sudo[88717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ce48d0cc-2eec-4f7e-b10f-60ed321ceff3 Jul 06 15:25:22 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:23 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5eca5817-73d8-482a-a998-77c443248e04 tempest-SnapshotsActionsTest-2022497539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.a76c0e64-9ebd-4e20-b3ff-695acd646886" returned: 0 in 1.307s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5eca5817-73d8-482a-a998-77c443248e04 tempest-SnapshotsActionsTest-2022497539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.a76c0e64-9ebd-4e20-b3ff-695acd646886 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:23 devstack sudo[88744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.a76c0e64-9ebd-4e20-b3ff-695acd646886 Jul 06 15:25:23 devstack sudo[88744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:23 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ce48d0cc-2eec-4f7e-b10f-60ed321ceff3" returned: 0 in 1.256s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] <== create_volume: return (2511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:25:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.514s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:25:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d238bcf0-3d80-4451-a1fb-0fbd1d9e3a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce48d0cc-2eec-4f7e-b10f-60ed321ceff3', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:25:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff11015e-de17-44d5-8dcd-22b598a16738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:25:23 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Volume volume-ce48d0cc-2eec-4f7e-b10f-60ed321ceff3 (ce48d0cc-2eec-4f7e-b10f-60ed321ceff3): created successfully Jul 06 15:25:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff11015e-de17-44d5-8dcd-22b598a16738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:25:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Flow 'volume_create_manager' (dde7faec-614a-4ac7-91af-20adcaaaad92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:25:23 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-2e022b99-157a-489a-ade4-4e52132de58b tempest-ServerRescueNegativeTestJSON-2016733976 None] Created volume successfully. Jul 06 15:25:24 devstack sudo[88744]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5eca5817-73d8-482a-a998-77c443248e04 tempest-SnapshotsActionsTest-2022497539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.a76c0e64-9ebd-4e20-b3ff-695acd646886" returned: 0 in 0.913s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:24 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5eca5817-73d8-482a-a998-77c443248e04 tempest-SnapshotsActionsTest-2022497539 None] Lock "cinder-quobyte-a76c0e64-9ebd-4e20-b3ff-695acd646886" released by "_delete_snapshot" :: held 4.668s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:25:24 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5eca5817-73d8-482a-a998-77c443248e04 tempest-SnapshotsActionsTest-2022497539 None] Lock "cinder-quobyte-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8" released by "delete_snapshot" :: held 4.705s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:25:24 devstack cinder-volume[86148]: WARNING cinder.quota [None req-5eca5817-73d8-482a-a998-77c443248e04 tempest-SnapshotsActionsTest-2022497539 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:25:24 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-5eca5817-73d8-482a-a998-77c443248e04 tempest-SnapshotsActionsTest-2022497539 None] Created reservations ['402e5696-4395-4883-9d31-38bf05458d97', '5af899e9-1cf2-43b2-8a03-76256dbe9455', 'd13425b5-b19c-4bf1-91c6-777388f264a1', '006a0ddf-5442-4bc0-bbb3-aa658324cb29'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:25:24 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-5eca5817-73d8-482a-a998-77c443248e04 tempest-SnapshotsActionsTest-2022497539 None] Delete snapshot completed successfully. Jul 06 15:25:24 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5eca5817-73d8-482a-a998-77c443248e04 tempest-SnapshotsActionsTest-2022497539 None] Lock "cinder-a76c0e64-9ebd-4e20-b3ff-695acd646886-delete_snapshot" released by "delete_snapshot" :: held 4.958s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:25:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2d545b81-d395-482e-a7cb-a586f4f43601 tempest-SnapshotsActionsTest-572684038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:25:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2d545b81-d395-482e-a7cb-a586f4f43601 tempest-SnapshotsActionsTest-572684038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:25:25 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-2d545b81-d395-482e-a7cb-a586f4f43601 tempest-SnapshotsActionsTest-572684038 None] Creating offline snapshot 3606eb9e-8ac4-4f28-ad8a-e782c76aeb58 of volume 4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:25:25 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef870636-0bdc-48a2-91c8-6d68775ea580]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:25:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2d545b81-d395-482e-a7cb-a586f4f43601 tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:26 devstack sudo[88770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 Jul 06 15:25:26 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:27 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2d545b81-d395-482e-a7cb-a586f4f43601 tempest-SnapshotsActionsTest-572684038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081" returned: 0 in 1.987s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:27 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-2d545b81-d395-482e-a7cb-a586f4f43601 tempest-SnapshotsActionsTest-572684038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:25:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2d545b81-d395-482e-a7cb-a586f4f43601 tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.3606eb9e-8ac4-4f28-ad8a-e782c76aeb58 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:27 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.3606eb9e-8ac4-4f28-ad8a-e782c76aeb58 1G Jul 06 15:25:27 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:29 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2d545b81-d395-482e-a7cb-a586f4f43601 tempest-SnapshotsActionsTest-572684038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.3606eb9e-8ac4-4f28-ad8a-e782c76aeb58 1G" returned: 0 in 1.379s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2d545b81-d395-482e-a7cb-a586f4f43601 tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.3606eb9e-8ac4-4f28-ad8a-e782c76aeb58 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:29 devstack sudo[88839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.3606eb9e-8ac4-4f28-ad8a-e782c76aeb58 Jul 06 15:25:29 devstack sudo[88839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:30 devstack sudo[88839]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2d545b81-d395-482e-a7cb-a586f4f43601 tempest-SnapshotsActionsTest-572684038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.3606eb9e-8ac4-4f28-ad8a-e782c76aeb58" returned: 0 in 1.432s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:30 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-2d545b81-d395-482e-a7cb-a586f4f43601 tempest-SnapshotsActionsTest-572684038 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.3606eb9e-8ac4-4f28-ad8a-e782c76aeb58 is being set with open permissions: ugo+rw Jul 06 15:25:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2d545b81-d395-482e-a7cb-a586f4f43601 tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.3606eb9e-8ac4-4f28-ad8a-e782c76aeb58 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:30 devstack sudo[88867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.3606eb9e-8ac4-4f28-ad8a-e782c76aeb58 Jul 06 15:25:30 devstack sudo[88867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:31 devstack sudo[88867]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2d545b81-d395-482e-a7cb-a586f4f43601 tempest-SnapshotsActionsTest-572684038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.3606eb9e-8ac4-4f28-ad8a-e782c76aeb58" returned: 0 in 1.074s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2d545b81-d395-482e-a7cb-a586f4f43601 tempest-SnapshotsActionsTest-572684038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.106s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:25:31 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-2d545b81-d395-482e-a7cb-a586f4f43601 tempest-SnapshotsActionsTest-572684038 None] Create snapshot completed successfully Jul 06 15:25:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a58d22d5-a5c8-43af-8410-4d0843708d13 tempest-SnapshotsActionsTest-2022497539 None] Acquiring lock "cinder-3606eb9e-8ac4-4f28-ad8a-e782c76aeb58-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:25:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a58d22d5-a5c8-43af-8410-4d0843708d13 tempest-SnapshotsActionsTest-2022497539 None] Lock "cinder-3606eb9e-8ac4-4f28-ad8a-e782c76aeb58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:25:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a58d22d5-a5c8-43af-8410-4d0843708d13 tempest-SnapshotsActionsTest-2022497539 None] Acquiring lock "cinder-quobyte-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:25:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a58d22d5-a5c8-43af-8410-4d0843708d13 tempest-SnapshotsActionsTest-2022497539 None] Lock "cinder-quobyte-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:25:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a58d22d5-a5c8-43af-8410-4d0843708d13 tempest-SnapshotsActionsTest-2022497539 None] Acquiring lock "cinder-quobyte-3606eb9e-8ac4-4f28-ad8a-e782c76aeb58" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:25:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a58d22d5-a5c8-43af-8410-4d0843708d13 tempest-SnapshotsActionsTest-2022497539 None] Lock "cinder-quobyte-3606eb9e-8ac4-4f28-ad8a-e782c76aeb58" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:25:32 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-a58d22d5-a5c8-43af-8410-4d0843708d13 tempest-SnapshotsActionsTest-2022497539 None] Deleting offline snapshot 3606eb9e-8ac4-4f28-ad8a-e782c76aeb58 of volume 4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:25:32 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-a58d22d5-a5c8-43af-8410-4d0843708d13 tempest-SnapshotsActionsTest-2022497539 None] snapshot_file for this snap is: volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.3606eb9e-8ac4-4f28-ad8a-e782c76aeb58 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:25:32 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2c35fa-e0ec-44c8-abe6-5b20edf68ca3]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:25:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a58d22d5-a5c8-43af-8410-4d0843708d13 tempest-SnapshotsActionsTest-2022497539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.3606eb9e-8ac4-4f28-ad8a-e782c76aeb58 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:32 devstack sudo[88917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.3606eb9e-8ac4-4f28-ad8a-e782c76aeb58 Jul 06 15:25:32 devstack sudo[88917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:33 devstack sudo[88917]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a58d22d5-a5c8-43af-8410-4d0843708d13 tempest-SnapshotsActionsTest-2022497539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.3606eb9e-8ac4-4f28-ad8a-e782c76aeb58" returned: 0 in 1.180s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-a58d22d5-a5c8-43af-8410-4d0843708d13 tempest-SnapshotsActionsTest-2022497539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:25:33 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[4707c617-151e-40b1-b461-1b784945fddf]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:25:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a58d22d5-a5c8-43af-8410-4d0843708d13 tempest-SnapshotsActionsTest-2022497539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:33 devstack sudo[88952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 Jul 06 15:25:33 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:34 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a58d22d5-a5c8-43af-8410-4d0843708d13 tempest-SnapshotsActionsTest-2022497539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081" returned: 0 in 0.838s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-a58d22d5-a5c8-43af-8410-4d0843708d13 tempest-SnapshotsActionsTest-2022497539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:25:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a58d22d5-a5c8-43af-8410-4d0843708d13 tempest-SnapshotsActionsTest-2022497539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.3606eb9e-8ac4-4f28-ad8a-e782c76aeb58 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:34 devstack sudo[88959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.3606eb9e-8ac4-4f28-ad8a-e782c76aeb58 Jul 06 15:25:34 devstack sudo[88959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:35 devstack sudo[88959]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a58d22d5-a5c8-43af-8410-4d0843708d13 tempest-SnapshotsActionsTest-2022497539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.3606eb9e-8ac4-4f28-ad8a-e782c76aeb58" returned: 0 in 1.063s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a58d22d5-a5c8-43af-8410-4d0843708d13 tempest-SnapshotsActionsTest-2022497539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.3606eb9e-8ac4-4f28-ad8a-e782c76aeb58 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:35 devstack sudo[88991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.3606eb9e-8ac4-4f28-ad8a-e782c76aeb58 Jul 06 15:25:35 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:36 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a58d22d5-a5c8-43af-8410-4d0843708d13 tempest-SnapshotsActionsTest-2022497539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.3606eb9e-8ac4-4f28-ad8a-e782c76aeb58" returned: 0 in 0.845s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a58d22d5-a5c8-43af-8410-4d0843708d13 tempest-SnapshotsActionsTest-2022497539 None] Lock "cinder-quobyte-3606eb9e-8ac4-4f28-ad8a-e782c76aeb58" released by "_delete_snapshot" :: held 4.102s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:25:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a58d22d5-a5c8-43af-8410-4d0843708d13 tempest-SnapshotsActionsTest-2022497539 None] Lock "cinder-quobyte-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8" released by "delete_snapshot" :: held 4.137s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:25:36 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-a58d22d5-a5c8-43af-8410-4d0843708d13 tempest-SnapshotsActionsTest-2022497539 None] Created reservations ['e1672152-2b95-4c4c-98db-dd6f5cc4c9bf', '328f99bc-9301-4181-9702-2ec05871a679', '6716f1d7-30d5-4975-9c2b-4c92c755be69', '61c13ce6-1469-4dfe-b72d-a4e5ae7ae941'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:25:36 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a58d22d5-a5c8-43af-8410-4d0843708d13 tempest-SnapshotsActionsTest-2022497539 None] Delete snapshot completed successfully. Jul 06 15:25:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a58d22d5-a5c8-43af-8410-4d0843708d13 tempest-SnapshotsActionsTest-2022497539 None] Lock "cinder-3606eb9e-8ac4-4f28-ad8a-e782c76aeb58-delete_snapshot" released by "delete_snapshot" :: held 4.454s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:25:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:25:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:25:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:25:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:25:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:25:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:25:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:38 devstack sudo[88999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:25:38 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-db8cf41f-412b-4b37-ae3d-307ce19b94a7 tempest-SnapshotsActionsTest-572684038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:25:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-db8cf41f-412b-4b37-ae3d-307ce19b94a7 tempest-SnapshotsActionsTest-572684038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:25:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-db8cf41f-412b-4b37-ae3d-307ce19b94a7 tempest-SnapshotsActionsTest-572684038 None] Creating offline snapshot 0ccaa27d-c47d-4d85-88d8-047f3a4c2b80 of volume 4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:25:38 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0996e8-6dfc-46bf-8e60-ad3785d0eced]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:25:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-db8cf41f-412b-4b37-ae3d-307ce19b94a7 tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:38 devstack sudo[89001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 Jul 06 15:25:38 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:40 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.674s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:40 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:25:40 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager._thread_info {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:25:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread count: 8 {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:25:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread info: [<_MainThread(MainThread, started 124857273856128)>, , , , , , , ] {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:25:40 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-db8cf41f-412b-4b37-ae3d-307ce19b94a7 tempest-SnapshotsActionsTest-572684038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081" returned: 0 in 2.339s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:41 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-db8cf41f-412b-4b37-ae3d-307ce19b94a7 tempest-SnapshotsActionsTest-572684038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:25:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-db8cf41f-412b-4b37-ae3d-307ce19b94a7 tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.0ccaa27d-c47d-4d85-88d8-047f3a4c2b80 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:41 devstack sudo[89010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.0ccaa27d-c47d-4d85-88d8-047f3a4c2b80 1G Jul 06 15:25:41 devstack sudo[89010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:42 devstack sudo[89010]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-db8cf41f-412b-4b37-ae3d-307ce19b94a7 tempest-SnapshotsActionsTest-572684038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.0ccaa27d-c47d-4d85-88d8-047f3a4c2b80 1G" returned: 0 in 1.126s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-db8cf41f-412b-4b37-ae3d-307ce19b94a7 tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.0ccaa27d-c47d-4d85-88d8-047f3a4c2b80 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:42 devstack sudo[89024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.0ccaa27d-c47d-4d85-88d8-047f3a4c2b80 Jul 06 15:25:42 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:43 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-db8cf41f-412b-4b37-ae3d-307ce19b94a7 tempest-SnapshotsActionsTest-572684038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.0ccaa27d-c47d-4d85-88d8-047f3a4c2b80" returned: 0 in 0.918s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:43 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-db8cf41f-412b-4b37-ae3d-307ce19b94a7 tempest-SnapshotsActionsTest-572684038 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.0ccaa27d-c47d-4d85-88d8-047f3a4c2b80 is being set with open permissions: ugo+rw Jul 06 15:25:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-db8cf41f-412b-4b37-ae3d-307ce19b94a7 tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.0ccaa27d-c47d-4d85-88d8-047f3a4c2b80 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:43 devstack sudo[89079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.0ccaa27d-c47d-4d85-88d8-047f3a4c2b80 Jul 06 15:25:43 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:43 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-db8cf41f-412b-4b37-ae3d-307ce19b94a7 tempest-SnapshotsActionsTest-572684038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.0ccaa27d-c47d-4d85-88d8-047f3a4c2b80" returned: 0 in 0.721s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-db8cf41f-412b-4b37-ae3d-307ce19b94a7 tempest-SnapshotsActionsTest-572684038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.310s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:25:43 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-db8cf41f-412b-4b37-ae3d-307ce19b94a7 tempest-SnapshotsActionsTest-572684038 None] Create snapshot completed successfully Jul 06 15:25:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a630857a-251a-453a-8dee-cdb10386dfc7 tempest-SnapshotsActionsTest-2022497539 None] Acquiring lock "cinder-0ccaa27d-c47d-4d85-88d8-047f3a4c2b80-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:25:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a630857a-251a-453a-8dee-cdb10386dfc7 tempest-SnapshotsActionsTest-2022497539 None] Lock "cinder-0ccaa27d-c47d-4d85-88d8-047f3a4c2b80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:25:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a630857a-251a-453a-8dee-cdb10386dfc7 tempest-SnapshotsActionsTest-2022497539 None] Acquiring lock "cinder-quobyte-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:25:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a630857a-251a-453a-8dee-cdb10386dfc7 tempest-SnapshotsActionsTest-2022497539 None] Lock "cinder-quobyte-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:25:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a630857a-251a-453a-8dee-cdb10386dfc7 tempest-SnapshotsActionsTest-2022497539 None] Acquiring lock "cinder-quobyte-0ccaa27d-c47d-4d85-88d8-047f3a4c2b80" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:25:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a630857a-251a-453a-8dee-cdb10386dfc7 tempest-SnapshotsActionsTest-2022497539 None] Lock "cinder-quobyte-0ccaa27d-c47d-4d85-88d8-047f3a4c2b80" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:25:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-a630857a-251a-453a-8dee-cdb10386dfc7 tempest-SnapshotsActionsTest-2022497539 None] Deleting offline snapshot 0ccaa27d-c47d-4d85-88d8-047f3a4c2b80 of volume 4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:25:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-a630857a-251a-453a-8dee-cdb10386dfc7 tempest-SnapshotsActionsTest-2022497539 None] snapshot_file for this snap is: volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.0ccaa27d-c47d-4d85-88d8-047f3a4c2b80 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:25:44 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaae57a-53a3-4632-a6b1-5a7c6f0dfaff]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:25:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a630857a-251a-453a-8dee-cdb10386dfc7 tempest-SnapshotsActionsTest-2022497539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.0ccaa27d-c47d-4d85-88d8-047f3a4c2b80 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:44 devstack sudo[89083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.0ccaa27d-c47d-4d85-88d8-047f3a4c2b80 Jul 06 15:25:44 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:45 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ede396e0-1a5f-405f-bae1-8def98e1049f tempest-ServerRescueNegativeTestJSON-2016733976 None] Acquiring lock "cinder-ce48d0cc-2eec-4f7e-b10f-60ed321ceff3-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:25:45 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a630857a-251a-453a-8dee-cdb10386dfc7 tempest-SnapshotsActionsTest-2022497539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.0ccaa27d-c47d-4d85-88d8-047f3a4c2b80" returned: 0 in 0.944s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-a630857a-251a-453a-8dee-cdb10386dfc7 tempest-SnapshotsActionsTest-2022497539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:25:45 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ede396e0-1a5f-405f-bae1-8def98e1049f tempest-ServerRescueNegativeTestJSON-2016733976 None] Lock "cinder-ce48d0cc-2eec-4f7e-b10f-60ed321ceff3-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:25:45 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fde5b9-1dc0-49a7-8f3c-e14f5bca039e]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:25:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a630857a-251a-453a-8dee-cdb10386dfc7 tempest-SnapshotsActionsTest-2022497539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:45 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ede396e0-1a5f-405f-bae1-8def98e1049f tempest-ServerRescueNegativeTestJSON-2016733976 None] Acquiring lock "cinder-quobyte-ce48d0cc-2eec-4f7e-b10f-60ed321ceff3" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:25:45 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ede396e0-1a5f-405f-bae1-8def98e1049f tempest-ServerRescueNegativeTestJSON-2016733976 None] Lock "cinder-quobyte-ce48d0cc-2eec-4f7e-b10f-60ed321ceff3" acquired by "delete_volume" :: waited 0.037s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:25:45 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bb2f47-7a7e-4091-b185-735d98d3da38]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:25:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ede396e0-1a5f-405f-bae1-8def98e1049f tempest-ServerRescueNegativeTestJSON-2016733976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ce48d0cc-2eec-4f7e-b10f-60ed321ceff3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:45 devstack sudo[89089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 Jul 06 15:25:45 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:45 devstack sudo[89090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ce48d0cc-2eec-4f7e-b10f-60ed321ceff3 Jul 06 15:25:45 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:46 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a630857a-251a-453a-8dee-cdb10386dfc7 tempest-SnapshotsActionsTest-2022497539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081" returned: 0 in 0.944s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-a630857a-251a-453a-8dee-cdb10386dfc7 tempest-SnapshotsActionsTest-2022497539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:25:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a630857a-251a-453a-8dee-cdb10386dfc7 tempest-SnapshotsActionsTest-2022497539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.0ccaa27d-c47d-4d85-88d8-047f3a4c2b80 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:46 devstack sudo[89097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.0ccaa27d-c47d-4d85-88d8-047f3a4c2b80 Jul 06 15:25:46 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:46 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ede396e0-1a5f-405f-bae1-8def98e1049f tempest-ServerRescueNegativeTestJSON-2016733976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ce48d0cc-2eec-4f7e-b10f-60ed321ceff3" returned: 0 in 1.072s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ede396e0-1a5f-405f-bae1-8def98e1049f tempest-ServerRescueNegativeTestJSON-2016733976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ce48d0cc-2eec-4f7e-b10f-60ed321ceff3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:46 devstack sudo[89102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ce48d0cc-2eec-4f7e-b10f-60ed321ceff3 Jul 06 15:25:46 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:47 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a630857a-251a-453a-8dee-cdb10386dfc7 tempest-SnapshotsActionsTest-2022497539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.0ccaa27d-c47d-4d85-88d8-047f3a4c2b80" returned: 0 in 0.974s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a630857a-251a-453a-8dee-cdb10386dfc7 tempest-SnapshotsActionsTest-2022497539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.0ccaa27d-c47d-4d85-88d8-047f3a4c2b80 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:47 devstack sudo[89109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.0ccaa27d-c47d-4d85-88d8-047f3a4c2b80 Jul 06 15:25:47 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:47 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ede396e0-1a5f-405f-bae1-8def98e1049f tempest-ServerRescueNegativeTestJSON-2016733976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ce48d0cc-2eec-4f7e-b10f-60ed321ceff3" returned: 0 in 0.772s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:47 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ede396e0-1a5f-405f-bae1-8def98e1049f tempest-ServerRescueNegativeTestJSON-2016733976 None] Lock "cinder-quobyte-ce48d0cc-2eec-4f7e-b10f-60ed321ceff3" released by "delete_volume" :: held 1.897s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:25:47 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-ede396e0-1a5f-405f-bae1-8def98e1049f tempest-ServerRescueNegativeTestJSON-2016733976 None] Created reservations ['46838bf8-701b-4e5d-9ca4-2815a36a965e', '2806b401-267b-4f1a-a4b9-ea71c77ad993', 'a3b0a399-c06c-4435-8ec2-26009f39a993', 'a2c1ec11-1d07-47cc-9887-97fd342a845f'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:25:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ede396e0-1a5f-405f-bae1-8def98e1049f tempest-ServerRescueNegativeTestJSON-2016733976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:25:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ede396e0-1a5f-405f-bae1-8def98e1049f tempest-ServerRescueNegativeTestJSON-2016733976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:25:47 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ede396e0-1a5f-405f-bae1-8def98e1049f tempest-ServerRescueNegativeTestJSON-2016733976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:25:47 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ede396e0-1a5f-405f-bae1-8def98e1049f tempest-ServerRescueNegativeTestJSON-2016733976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:25:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ede396e0-1a5f-405f-bae1-8def98e1049f tempest-ServerRescueNegativeTestJSON-2016733976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:25:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ede396e0-1a5f-405f-bae1-8def98e1049f tempest-ServerRescueNegativeTestJSON-2016733976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:47 devstack sudo[89111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:25:47 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:48 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a630857a-251a-453a-8dee-cdb10386dfc7 tempest-SnapshotsActionsTest-2022497539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.0ccaa27d-c47d-4d85-88d8-047f3a4c2b80" returned: 0 in 1.173s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a630857a-251a-453a-8dee-cdb10386dfc7 tempest-SnapshotsActionsTest-2022497539 None] Lock "cinder-quobyte-0ccaa27d-c47d-4d85-88d8-047f3a4c2b80" released by "_delete_snapshot" :: held 4.167s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:25:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a630857a-251a-453a-8dee-cdb10386dfc7 tempest-SnapshotsActionsTest-2022497539 None] Lock "cinder-quobyte-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8" released by "delete_snapshot" :: held 4.197s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:25:48 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-a630857a-251a-453a-8dee-cdb10386dfc7 tempest-SnapshotsActionsTest-2022497539 None] Created reservations ['bf511cca-8c02-4ae6-85cb-7fb0c4b395c6', 'dc1e2d31-42d5-40e8-af5e-5dd770ac240f', 'e7b122b5-15f6-4588-9972-40caf9fc543d', 'c98a9df3-58db-4c63-a2a0-0c01c5da9578'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:25:48 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a630857a-251a-453a-8dee-cdb10386dfc7 tempest-SnapshotsActionsTest-2022497539 None] Delete snapshot completed successfully. Jul 06 15:25:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a630857a-251a-453a-8dee-cdb10386dfc7 tempest-SnapshotsActionsTest-2022497539 None] Lock "cinder-0ccaa27d-c47d-4d85-88d8-047f3a4c2b80-delete_snapshot" released by "delete_snapshot" :: held 4.410s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:25:48 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ede396e0-1a5f-405f-bae1-8def98e1049f tempest-ServerRescueNegativeTestJSON-2016733976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.149s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:48 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-ede396e0-1a5f-405f-bae1-8def98e1049f tempest-ServerRescueNegativeTestJSON-2016733976 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:25:48 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-ede396e0-1a5f-405f-bae1-8def98e1049f tempest-ServerRescueNegativeTestJSON-2016733976 None] Deleted volume successfully. Jul 06 15:25:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ede396e0-1a5f-405f-bae1-8def98e1049f tempest-ServerRescueNegativeTestJSON-2016733976 None] Lock "cinder-ce48d0cc-2eec-4f7e-b10f-60ed321ceff3-delete_volume" released by "delete_volume" :: held 3.382s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:25:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d447ebc6-96fd-472f-9c33-ed4e6b5e1c9b tempest-SnapshotsActionsTest-572684038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:25:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d447ebc6-96fd-472f-9c33-ed4e6b5e1c9b tempest-SnapshotsActionsTest-572684038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:25:50 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-d447ebc6-96fd-472f-9c33-ed4e6b5e1c9b tempest-SnapshotsActionsTest-572684038 None] Creating offline snapshot b03ae95e-fbb5-4cf0-b17e-d15cebc176f2 of volume 4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:25:50 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[9711989c-bcea-4f3d-8719-3fa680f670e1]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:25:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d447ebc6-96fd-472f-9c33-ed4e6b5e1c9b tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:50 devstack sudo[89145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 Jul 06 15:25:50 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:52 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d447ebc6-96fd-472f-9c33-ed4e6b5e1c9b tempest-SnapshotsActionsTest-572684038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081" returned: 0 in 1.761s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:52 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-d447ebc6-96fd-472f-9c33-ed4e6b5e1c9b tempest-SnapshotsActionsTest-572684038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:25:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d447ebc6-96fd-472f-9c33-ed4e6b5e1c9b tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.b03ae95e-fbb5-4cf0-b17e-d15cebc176f2 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:52 devstack sudo[89212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.b03ae95e-fbb5-4cf0-b17e-d15cebc176f2 1G Jul 06 15:25:52 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:53 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d447ebc6-96fd-472f-9c33-ed4e6b5e1c9b tempest-SnapshotsActionsTest-572684038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.b03ae95e-fbb5-4cf0-b17e-d15cebc176f2 1G" returned: 0 in 0.876s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d447ebc6-96fd-472f-9c33-ed4e6b5e1c9b tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.b03ae95e-fbb5-4cf0-b17e-d15cebc176f2 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:53 devstack sudo[89229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.b03ae95e-fbb5-4cf0-b17e-d15cebc176f2 Jul 06 15:25:53 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:53 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d447ebc6-96fd-472f-9c33-ed4e6b5e1c9b tempest-SnapshotsActionsTest-572684038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.b03ae95e-fbb5-4cf0-b17e-d15cebc176f2" returned: 0 in 0.687s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:53 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-d447ebc6-96fd-472f-9c33-ed4e6b5e1c9b tempest-SnapshotsActionsTest-572684038 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.b03ae95e-fbb5-4cf0-b17e-d15cebc176f2 is being set with open permissions: ugo+rw Jul 06 15:25:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d447ebc6-96fd-472f-9c33-ed4e6b5e1c9b tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.b03ae95e-fbb5-4cf0-b17e-d15cebc176f2 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:53 devstack sudo[89234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.b03ae95e-fbb5-4cf0-b17e-d15cebc176f2 Jul 06 15:25:53 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:54 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d447ebc6-96fd-472f-9c33-ed4e6b5e1c9b tempest-SnapshotsActionsTest-572684038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.b03ae95e-fbb5-4cf0-b17e-d15cebc176f2" returned: 0 in 0.775s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d447ebc6-96fd-472f-9c33-ed4e6b5e1c9b tempest-SnapshotsActionsTest-572684038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.416s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:25:54 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-d447ebc6-96fd-472f-9c33-ed4e6b5e1c9b tempest-SnapshotsActionsTest-572684038 None] Create snapshot completed successfully Jul 06 15:25:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dcb6d84d-db67-488f-b593-12c1160cf9ad tempest-SnapshotsActionsTest-2022497539 None] Acquiring lock "cinder-b03ae95e-fbb5-4cf0-b17e-d15cebc176f2-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:25:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dcb6d84d-db67-488f-b593-12c1160cf9ad tempest-SnapshotsActionsTest-2022497539 None] Lock "cinder-b03ae95e-fbb5-4cf0-b17e-d15cebc176f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:25:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dcb6d84d-db67-488f-b593-12c1160cf9ad tempest-SnapshotsActionsTest-2022497539 None] Acquiring lock "cinder-quobyte-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:25:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dcb6d84d-db67-488f-b593-12c1160cf9ad tempest-SnapshotsActionsTest-2022497539 None] Lock "cinder-quobyte-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:25:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dcb6d84d-db67-488f-b593-12c1160cf9ad tempest-SnapshotsActionsTest-2022497539 None] Acquiring lock "cinder-quobyte-b03ae95e-fbb5-4cf0-b17e-d15cebc176f2" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:25:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dcb6d84d-db67-488f-b593-12c1160cf9ad tempest-SnapshotsActionsTest-2022497539 None] Lock "cinder-quobyte-b03ae95e-fbb5-4cf0-b17e-d15cebc176f2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:25:55 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-dcb6d84d-db67-488f-b593-12c1160cf9ad tempest-SnapshotsActionsTest-2022497539 None] Deleting offline snapshot b03ae95e-fbb5-4cf0-b17e-d15cebc176f2 of volume 4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:25:55 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-dcb6d84d-db67-488f-b593-12c1160cf9ad tempest-SnapshotsActionsTest-2022497539 None] snapshot_file for this snap is: volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.b03ae95e-fbb5-4cf0-b17e-d15cebc176f2 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:25:55 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ad1d00-a062-4ac2-a479-917649a6dc4a]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:25:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dcb6d84d-db67-488f-b593-12c1160cf9ad tempest-SnapshotsActionsTest-2022497539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.b03ae95e-fbb5-4cf0-b17e-d15cebc176f2 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:56 devstack sudo[89238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.b03ae95e-fbb5-4cf0-b17e-d15cebc176f2 Jul 06 15:25:56 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:56 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dcb6d84d-db67-488f-b593-12c1160cf9ad tempest-SnapshotsActionsTest-2022497539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.b03ae95e-fbb5-4cf0-b17e-d15cebc176f2" returned: 0 in 0.924s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-dcb6d84d-db67-488f-b593-12c1160cf9ad tempest-SnapshotsActionsTest-2022497539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:25:56 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98950fc-7ba7-4775-b264-7dcb1c37f669]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:25:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dcb6d84d-db67-488f-b593-12c1160cf9ad tempest-SnapshotsActionsTest-2022497539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:56 devstack sudo[89245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 Jul 06 15:25:56 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:57 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dcb6d84d-db67-488f-b593-12c1160cf9ad tempest-SnapshotsActionsTest-2022497539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081" returned: 0 in 0.787s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:57 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-dcb6d84d-db67-488f-b593-12c1160cf9ad tempest-SnapshotsActionsTest-2022497539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:25:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dcb6d84d-db67-488f-b593-12c1160cf9ad tempest-SnapshotsActionsTest-2022497539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.b03ae95e-fbb5-4cf0-b17e-d15cebc176f2 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:57 devstack sudo[89250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.b03ae95e-fbb5-4cf0-b17e-d15cebc176f2 Jul 06 15:25:57 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:58 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dcb6d84d-db67-488f-b593-12c1160cf9ad tempest-SnapshotsActionsTest-2022497539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.b03ae95e-fbb5-4cf0-b17e-d15cebc176f2" returned: 0 in 0.849s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dcb6d84d-db67-488f-b593-12c1160cf9ad tempest-SnapshotsActionsTest-2022497539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.b03ae95e-fbb5-4cf0-b17e-d15cebc176f2 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:58 devstack sudo[89261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.b03ae95e-fbb5-4cf0-b17e-d15cebc176f2 Jul 06 15:25:58 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:59 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dcb6d84d-db67-488f-b593-12c1160cf9ad tempest-SnapshotsActionsTest-2022497539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.b03ae95e-fbb5-4cf0-b17e-d15cebc176f2" returned: 0 in 0.726s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dcb6d84d-db67-488f-b593-12c1160cf9ad tempest-SnapshotsActionsTest-2022497539 None] Lock "cinder-quobyte-b03ae95e-fbb5-4cf0-b17e-d15cebc176f2" released by "_delete_snapshot" :: held 3.427s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:25:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dcb6d84d-db67-488f-b593-12c1160cf9ad tempest-SnapshotsActionsTest-2022497539 None] Lock "cinder-quobyte-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8" released by "delete_snapshot" :: held 3.454s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:25:59 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=35,cinder:UPDATE=35,cinder:INSERT=11,cinder:DELETE=8 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:25:59 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=43,cinder:UPDATE=43,cinder:INSERT=9,cinder:DELETE=1 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:25:59 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-dcb6d84d-db67-488f-b593-12c1160cf9ad tempest-SnapshotsActionsTest-2022497539 None] Created reservations ['41042d59-eddb-485b-9ac5-da8e6e54a9e6', 'd95e1f74-cd14-47b4-aab1-16565bf92e4e', 'c172bec9-20ab-4c0a-8a28-65f0adcc6af8', '01aa72a7-464f-46d0-873f-628b913dbbd2'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:25:59 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-dcb6d84d-db67-488f-b593-12c1160cf9ad tempest-SnapshotsActionsTest-2022497539 None] Delete snapshot completed successfully. Jul 06 15:25:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dcb6d84d-db67-488f-b593-12c1160cf9ad tempest-SnapshotsActionsTest-2022497539 None] Lock "cinder-b03ae95e-fbb5-4cf0-b17e-d15cebc176f2-delete_snapshot" released by "delete_snapshot" :: held 3.626s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-3d6cf172-4de3-48ec-9b0a-e073c34f29e6 tempest-SnapshotsActionsTest-572684038 None] Acquiring lock "cinder-fc395685-2796-4791-880d-5b91d27d7081-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-3d6cf172-4de3-48ec-9b0a-e073c34f29e6 tempest-SnapshotsActionsTest-572684038 None] Lock "cinder-fc395685-2796-4791-880d-5b91d27d7081-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-3d6cf172-4de3-48ec-9b0a-e073c34f29e6 tempest-SnapshotsActionsTest-572684038 None] Acquiring lock "cinder-quobyte-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-3d6cf172-4de3-48ec-9b0a-e073c34f29e6 tempest-SnapshotsActionsTest-572684038 None] Lock "cinder-quobyte-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-3d6cf172-4de3-48ec-9b0a-e073c34f29e6 tempest-SnapshotsActionsTest-572684038 None] Acquiring lock "cinder-quobyte-fc395685-2796-4791-880d-5b91d27d7081" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-3d6cf172-4de3-48ec-9b0a-e073c34f29e6 tempest-SnapshotsActionsTest-572684038 None] Lock "cinder-quobyte-fc395685-2796-4791-880d-5b91d27d7081" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-3d6cf172-4de3-48ec-9b0a-e073c34f29e6 tempest-SnapshotsActionsTest-572684038 None] Deleting offline snapshot fc395685-2796-4791-880d-5b91d27d7081 of volume 4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-3d6cf172-4de3-48ec-9b0a-e073c34f29e6 tempest-SnapshotsActionsTest-572684038 None] snapshot_file for this snap is: volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[019394d5-2089-4db4-a375-7f31737d29dc]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3d6cf172-4de3-48ec-9b0a-e073c34f29e6 tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:26:01 devstack sudo[89327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 Jul 06 15:26:01 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Flow 'volume_create_manager' (ff11df3f-428a-454b-9905-d7298ad84a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83fffbdf-9503-4d73-98a6-3d098b5996bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83fffbdf-9503-4d73-98a6-3d098b5996bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1352531958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f56b04-7909-4301-9ff6-ef867bceb4c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95cfc2f1d5b44b56b819184e10cccc15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:26:01Z,use_quota=True,user_id='b6fbb1d98ed4482a9e1c707959922eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a8a5fd0-4924-4a3f-b277-2687e7538f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a8a5fd0-4924-4a3f-b277-2687e7538f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72396a11-bc91-43dd-8759-9e38527714f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72396a11-bc91-43dd-8759-9e38527714f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5f56b04-7909-4301-9ff6-ef867bceb4c3', 'volume_name': 'volume-a5f56b04-7909-4301-9ff6-ef867bceb4c3', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (140634db-0800-4b44-8ae7-2da514ef5458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (140634db-0800-4b44-8ae7-2da514ef5458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3595ed-9a8e-49a3-9080-6060be3120ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:26:01 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Volume a5f56b04-7909-4301-9ff6-ef867bceb4c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5f56b04-7909-4301-9ff6-ef867bceb4c3', 'volume_size': 1} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1352531958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f56b04-7909-4301-9ff6-ef867bceb4c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95cfc2f1d5b44b56b819184e10cccc15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:26:01Z,use_quota=True,user_id='b6fbb1d98ed4482a9e1c707959922eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Creating volume a5f56b04-7909-4301-9ff6-ef867bceb4c3 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:26:01 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:26:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a5f56b04-7909-4301-9ff6-ef867bceb4c3 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:26:01 devstack sudo[89337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a5f56b04-7909-4301-9ff6-ef867bceb4c3 1073741824 Jul 06 15:26:01 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:26:02 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root Jul 06 15:26:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3d6cf172-4de3-48ec-9b0a-e073c34f29e6 tempest-SnapshotsActionsTest-572684038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081" returned: 0 in 0.975s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:26:02 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-3d6cf172-4de3-48ec-9b0a-e073c34f29e6 tempest-SnapshotsActionsTest-572684038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:26:02 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e360b74-5bb9-4e67-9ec7-e8d70b64e446]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:26:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3d6cf172-4de3-48ec-9b0a-e073c34f29e6 tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:26:02 devstack sudo[89346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8 Jul 06 15:26:02 devstack sudo[89346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:26:02 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root Jul 06 15:26:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a5f56b04-7909-4301-9ff6-ef867bceb4c3 1073741824" returned: 0 in 1.046s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:26:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a5f56b04-7909-4301-9ff6-ef867bceb4c3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:26:02 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a5f56b04-7909-4301-9ff6-ef867bceb4c3 Jul 06 15:26:02 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:26:03 devstack sudo[89346]: pam_unix(sudo:session): session closed for user root Jul 06 15:26:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3d6cf172-4de3-48ec-9b0a-e073c34f29e6 tempest-SnapshotsActionsTest-572684038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8" returned: 0 in 0.844s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:26:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3d6cf172-4de3-48ec-9b0a-e073c34f29e6 tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:26:03 devstack sudo[89357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 Jul 06 15:26:03 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:26:03 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Jul 06 15:26:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a5f56b04-7909-4301-9ff6-ef867bceb4c3" returned: 0 in 0.662s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:26:03 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:26:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:26:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3595ed-9a8e-49a3-9080-6060be3120ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5f56b04-7909-4301-9ff6-ef867bceb4c3', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:26:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d70c828-40a6-48a0-b6d9-e3d59755f7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:26:03 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Volume volume-a5f56b04-7909-4301-9ff6-ef867bceb4c3 (a5f56b04-7909-4301-9ff6-ef867bceb4c3): created successfully Jul 06 15:26:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d70c828-40a6-48a0-b6d9-e3d59755f7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:26:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Flow 'volume_create_manager' (ff11df3f-428a-454b-9905-d7298ad84a27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:26:03 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a0d9c4e2-ad02-4609-a0b8-53a15060e529 tempest-AttachVolumeShelveTestJSON-932883443 None] Created volume successfully. Jul 06 15:26:04 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root Jul 06 15:26:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3d6cf172-4de3-48ec-9b0a-e073c34f29e6 tempest-SnapshotsActionsTest-572684038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081" returned: 0 in 0.896s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:26:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3d6cf172-4de3-48ec-9b0a-e073c34f29e6 tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:26:04 devstack sudo[89373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081 Jul 06 15:26:04 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:26:04 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root Jul 06 15:26:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3d6cf172-4de3-48ec-9b0a-e073c34f29e6 tempest-SnapshotsActionsTest-572684038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8.fc395685-2796-4791-880d-5b91d27d7081" returned: 0 in 0.657s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:26:04 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-3d6cf172-4de3-48ec-9b0a-e073c34f29e6 tempest-SnapshotsActionsTest-572684038 None] Lock "cinder-quobyte-fc395685-2796-4791-880d-5b91d27d7081" released by "_delete_snapshot" :: held 3.537s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:26:04 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-3d6cf172-4de3-48ec-9b0a-e073c34f29e6 tempest-SnapshotsActionsTest-572684038 None] Lock "cinder-quobyte-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8" released by "delete_snapshot" :: held 3.592s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:26:04 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-3d6cf172-4de3-48ec-9b0a-e073c34f29e6 tempest-SnapshotsActionsTest-572684038 None] Created reservations ['dce45614-563a-4d75-9a8b-fea9edbb335e', 'c232f431-0368-4c93-bd50-055657afb0b0', 'e9eb6363-c4fc-4df9-9466-336ca7f96de6', '428942e2-c803-4126-87fa-ca935e21b578'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:26:04 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-3d6cf172-4de3-48ec-9b0a-e073c34f29e6 tempest-SnapshotsActionsTest-572684038 None] Delete snapshot completed successfully. Jul 06 15:26:04 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-3d6cf172-4de3-48ec-9b0a-e073c34f29e6 tempest-SnapshotsActionsTest-572684038 None] Lock "cinder-fc395685-2796-4791-880d-5b91d27d7081-delete_snapshot" released by "delete_snapshot" :: held 3.747s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:26:05 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fa700dcb-edb5-473c-9b7e-9c466f1f4a04 tempest-SnapshotsActionsTest-572684038 None] Acquiring lock "cinder-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:26:05 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fa700dcb-edb5-473c-9b7e-9c466f1f4a04 tempest-SnapshotsActionsTest-572684038 None] Lock "cinder-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:26:05 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fa700dcb-edb5-473c-9b7e-9c466f1f4a04 tempest-SnapshotsActionsTest-572684038 None] Acquiring lock "cinder-quobyte-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:26:05 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fa700dcb-edb5-473c-9b7e-9c466f1f4a04 tempest-SnapshotsActionsTest-572684038 None] Lock "cinder-quobyte-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8" acquired by "delete_volume" :: waited 0.014s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:26:05 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c6a9fb-3579-484c-8f7f-e76956551de6]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:26:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fa700dcb-edb5-473c-9b7e-9c466f1f4a04 tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:26:05 devstack sudo[89379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8 Jul 06 15:26:05 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:26:06 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root Jul 06 15:26:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fa700dcb-edb5-473c-9b7e-9c466f1f4a04 tempest-SnapshotsActionsTest-572684038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8" returned: 0 in 0.832s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:26:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fa700dcb-edb5-473c-9b7e-9c466f1f4a04 tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:26:06 devstack sudo[89385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8 Jul 06 15:26:06 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:26:07 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root Jul 06 15:26:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fa700dcb-edb5-473c-9b7e-9c466f1f4a04 tempest-SnapshotsActionsTest-572684038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8" returned: 0 in 0.848s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:26:07 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fa700dcb-edb5-473c-9b7e-9c466f1f4a04 tempest-SnapshotsActionsTest-572684038 None] Lock "cinder-quobyte-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8" released by "delete_volume" :: held 1.745s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:26:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-c6a20091-3051-45b1-ae0c-44ba11c5ef0a req-054475ef-e177-44b5-b2f9-42f672ea41a8 tempest-TaggedAttachmentsTest-1741614252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:26:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-c6a20091-3051-45b1-ae0c-44ba11c5ef0a req-054475ef-e177-44b5-b2f9-42f672ea41a8 tempest-TaggedAttachmentsTest-1741614252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:26:07 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[a996b78d-64ae-4ac8-a7c1-55e2d3c6b997]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:26:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-c6a20091-3051-45b1-ae0c-44ba11c5ef0a req-054475ef-e177-44b5-b2f9-42f672ea41a8 tempest-TaggedAttachmentsTest-1741614252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1d022dff-f14c-490f-ab18-6470a43d7a4b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:26:07 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-fa700dcb-edb5-473c-9b7e-9c466f1f4a04 tempest-SnapshotsActionsTest-572684038 None] Created reservations ['0d3ce5d6-0e88-44de-98e3-775b50ba56c3', '38282edf-5bc6-4689-97d9-dd6f802a88e8', '6671f152-bf35-4090-bdf0-6b62142141a2', '096d842b-ff91-49f4-985a-306e98d69499'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:26:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fa700dcb-edb5-473c-9b7e-9c466f1f4a04 tempest-SnapshotsActionsTest-572684038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:26:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fa700dcb-edb5-473c-9b7e-9c466f1f4a04 tempest-SnapshotsActionsTest-572684038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:26:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fa700dcb-edb5-473c-9b7e-9c466f1f4a04 tempest-SnapshotsActionsTest-572684038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:26:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fa700dcb-edb5-473c-9b7e-9c466f1f4a04 tempest-SnapshotsActionsTest-572684038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:26:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fa700dcb-edb5-473c-9b7e-9c466f1f4a04 tempest-SnapshotsActionsTest-572684038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:26:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fa700dcb-edb5-473c-9b7e-9c466f1f4a04 tempest-SnapshotsActionsTest-572684038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:26:07 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1d022dff-f14c-490f-ab18-6470a43d7a4b Jul 06 15:26:07 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:26:07 devstack sudo[89404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:26:07 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:26:08 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Jul 06 15:26:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-c6a20091-3051-45b1-ae0c-44ba11c5ef0a req-054475ef-e177-44b5-b2f9-42f672ea41a8 tempest-TaggedAttachmentsTest-1741614252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1d022dff-f14c-490f-ab18-6470a43d7a4b" returned: 0 in 1.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:26:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-c6a20091-3051-45b1-ae0c-44ba11c5ef0a req-054475ef-e177-44b5-b2f9-42f672ea41a8 tempest-TaggedAttachmentsTest-1741614252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.046s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:26:08 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root Jul 06 15:26:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fa700dcb-edb5-473c-9b7e-9c466f1f4a04 tempest-SnapshotsActionsTest-572684038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.940s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:26:08 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-fa700dcb-edb5-473c-9b7e-9c466f1f4a04 tempest-SnapshotsActionsTest-572684038 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:26:08 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-fa700dcb-edb5-473c-9b7e-9c466f1f4a04 tempest-SnapshotsActionsTest-572684038 None] Deleted volume successfully. Jul 06 15:26:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-c6a20091-3051-45b1-ae0c-44ba11c5ef0a req-054475ef-e177-44b5-b2f9-42f672ea41a8 tempest-TaggedAttachmentsTest-1741614252 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce', 'name': 'volume-1d022dff-f14c-490f-ab18-6470a43d7a4b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '65c0cd1d-a8b4-4738-b1a2-97732a3e1214', 'enforce_multipath': True} {{(pid=86148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:26:08 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fa700dcb-edb5-473c-9b7e-9c466f1f4a04 tempest-SnapshotsActionsTest-572684038 None] Lock "cinder-4735ba8c-bdc3-45ad-ad45-3e68ef59fbd8-delete_volume" released by "delete_volume" :: held 2.964s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:26:08 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-c6a20091-3051-45b1-ae0c-44ba11c5ef0a req-054475ef-e177-44b5-b2f9-42f672ea41a8 tempest-TaggedAttachmentsTest-1741614252 None] attachment_update completed successfully. Jul 06 15:26:16 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-7e635f08-c6b9-4c20-bb15-313826b5cb97 req-c3f8dd45-c236-482d-b51d-34403d46964b tempest-TaggedAttachmentsTest-1741614252 None] Terminate volume connection completed successfully. Jul 06 15:26:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-7e635f08-c6b9-4c20-bb15-313826b5cb97 req-c3f8dd45-c236-482d-b51d-34403d46964b tempest-TaggedAttachmentsTest-1741614252 None] Deleting attachment 65c0cd1d-a8b4-4738-b1a2-97732a3e1214. {{(pid=86148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:26:16 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:26:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Flow 'volume_create_manager' (885b20c6-8f5a-4dc5-a0b4-4b77977df545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:26:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c0fcf8b-2b00-4f43-9b92-30af3134efb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:26:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c0fcf8b-2b00-4f43-9b92-30af3134efb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-652135454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1068a53-3aef-44d4-a04e-98e34425531c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3768d709a81647d89778205ece248a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:26:17Z,use_quota=True,user_id='43e46fc9e0644c5aac8cbe59729e1559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:26:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57197ce0-5bb4-4652-939c-d362e5a6330c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:26:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57197ce0-5bb4-4652-939c-d362e5a6330c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:26:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae3990f3-5c8f-4e6f-8f49-e5a38a9c608d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:26:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae3990f3-5c8f-4e6f-8f49-e5a38a9c608d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1068a53-3aef-44d4-a04e-98e34425531c', 'volume_name': 'volume-c1068a53-3aef-44d4-a04e-98e34425531c', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:26:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe629895-3a09-44c3-8b34-2fe365e0a8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:26:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe629895-3a09-44c3-8b34-2fe365e0a8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:26:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74531a9a-6e4a-43af-ae88-36779cd12f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:26:16 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Volume c1068a53-3aef-44d4-a04e-98e34425531c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1068a53-3aef-44d4-a04e-98e34425531c', 'volume_size': 1} Jul 06 15:26:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:26:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:26:17 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-652135454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1068a53-3aef-44d4-a04e-98e34425531c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3768d709a81647d89778205ece248a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:26:17Z,use_quota=True,user_id='43e46fc9e0644c5aac8cbe59729e1559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:26:17 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Creating volume c1068a53-3aef-44d4-a04e-98e34425531c {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:26:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:26:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:26:17 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:26:17 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:26:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:26:17 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:26:17 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:26:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c1068a53-3aef-44d4-a04e-98e34425531c 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:26:17 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c1068a53-3aef-44d4-a04e-98e34425531c 1073741824 Jul 06 15:26:17 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:26:18 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Jul 06 15:26:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c1068a53-3aef-44d4-a04e-98e34425531c 1073741824" returned: 0 in 1.106s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:26:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c1068a53-3aef-44d4-a04e-98e34425531c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:26:18 devstack sudo[89843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c1068a53-3aef-44d4-a04e-98e34425531c Jul 06 15:26:18 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:26:19 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root Jul 06 15:26:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c1068a53-3aef-44d4-a04e-98e34425531c" returned: 0 in 0.861s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:26:19 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] <== create_volume: return (2028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:26:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.032s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:26:19 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74531a9a-6e4a-43af-ae88-36779cd12f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1068a53-3aef-44d4-a04e-98e34425531c', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:26:19 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9cbdbdb-fe34-4296-b52c-a6a208e99db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:26:19 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Volume volume-c1068a53-3aef-44d4-a04e-98e34425531c (c1068a53-3aef-44d4-a04e-98e34425531c): created successfully Jul 06 15:26:19 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9cbdbdb-fe34-4296-b52c-a6a208e99db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:26:19 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Flow 'volume_create_manager' (885b20c6-8f5a-4dc5-a0b4-4b77977df545) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:26:19 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-2c0d198b-0eda-4d51-b1f2-916a52f95a17 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Created volume successfully. Jul 06 15:26:21 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-58d19e4f-1fe8-49d1-8be5-a7e109281bc9 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Acquiring lock "cinder-c1068a53-3aef-44d4-a04e-98e34425531c-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:26:21 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-58d19e4f-1fe8-49d1-8be5-a7e109281bc9 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Lock "cinder-c1068a53-3aef-44d4-a04e-98e34425531c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:26:21 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-58d19e4f-1fe8-49d1-8be5-a7e109281bc9 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Acquiring lock "cinder-quobyte-c1068a53-3aef-44d4-a04e-98e34425531c" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:26:21 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-58d19e4f-1fe8-49d1-8be5-a7e109281bc9 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Lock "cinder-quobyte-c1068a53-3aef-44d4-a04e-98e34425531c" acquired by "delete_volume" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:26:21 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[5890c896-8cc3-4e93-8551-c1dc2ec29791]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:26:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-58d19e4f-1fe8-49d1-8be5-a7e109281bc9 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c1068a53-3aef-44d4-a04e-98e34425531c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:26:21 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c1068a53-3aef-44d4-a04e-98e34425531c Jul 06 15:26:21 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:26:22 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Jul 06 15:26:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-58d19e4f-1fe8-49d1-8be5-a7e109281bc9 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c1068a53-3aef-44d4-a04e-98e34425531c" returned: 0 in 0.957s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:26:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-58d19e4f-1fe8-49d1-8be5-a7e109281bc9 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c1068a53-3aef-44d4-a04e-98e34425531c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:26:22 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c1068a53-3aef-44d4-a04e-98e34425531c Jul 06 15:26:22 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:26:23 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Jul 06 15:26:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-58d19e4f-1fe8-49d1-8be5-a7e109281bc9 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c1068a53-3aef-44d4-a04e-98e34425531c" returned: 0 in 0.912s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:26:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-58d19e4f-1fe8-49d1-8be5-a7e109281bc9 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Lock "cinder-quobyte-c1068a53-3aef-44d4-a04e-98e34425531c" released by "delete_volume" :: held 1.919s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:26:23 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-58d19e4f-1fe8-49d1-8be5-a7e109281bc9 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Created reservations ['5cfa15cc-4e87-4a6e-b93d-e2e3e81f2ac9', 'ace5705b-909e-4a6e-ae88-144f21fe2d4e', '17d955ca-487a-4e33-8877-ae245141212c', 'ef59c224-f29f-485c-8412-cddf96c20542'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:26:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-58d19e4f-1fe8-49d1-8be5-a7e109281bc9 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:26:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-58d19e4f-1fe8-49d1-8be5-a7e109281bc9 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:26:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-58d19e4f-1fe8-49d1-8be5-a7e109281bc9 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:26:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-58d19e4f-1fe8-49d1-8be5-a7e109281bc9 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:26:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-58d19e4f-1fe8-49d1-8be5-a7e109281bc9 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:26:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-58d19e4f-1fe8-49d1-8be5-a7e109281bc9 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:26:23 devstack sudo[89890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:26:23 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:26:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-b20c95c9-bbcc-4137-b62e-a442e923e704 req-4fefb0c1-d880-4e2c-93c9-a6face372b9f tempest-AttachVolumeShelveTestJSON-932883443 None] No connector for attachment f837bb3d-5bc0-4306-a590-cda65883dc65; skipping storage backend terminate_connection call. {{(pid=86148) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 06 15:26:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-b20c95c9-bbcc-4137-b62e-a442e923e704 req-4fefb0c1-d880-4e2c-93c9-a6face372b9f tempest-AttachVolumeShelveTestJSON-932883443 None] Deleting attachment f837bb3d-5bc0-4306-a590-cda65883dc65. {{(pid=86148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:26:24 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root Jul 06 15:26:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-58d19e4f-1fe8-49d1-8be5-a7e109281bc9 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.909s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:26:24 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-58d19e4f-1fe8-49d1-8be5-a7e109281bc9 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:26:24 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-58d19e4f-1fe8-49d1-8be5-a7e109281bc9 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Deleted volume successfully. Jul 06 15:26:24 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-58d19e4f-1fe8-49d1-8be5-a7e109281bc9 tempest-VolumeQuotasNegativeTestJSON-1943754956 None] Lock "cinder-c1068a53-3aef-44d4-a04e-98e34425531c-delete_volume" released by "delete_volume" :: held 3.102s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:26:33 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:INSERT=12,cinder:UPDATE=40,cinder:SELECT=26,cinder:DELETE=1 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:26:34 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=35,cinder:INSERT=6,cinder:UPDATE=29,cinder:DELETE=3 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:26:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fc0e0561-4e59-406b-aeb5-1787130dd8de tempest-TaggedAttachmentsTest-1741614252 None] Acquiring lock "cinder-1d022dff-f14c-490f-ab18-6470a43d7a4b-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:26:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fc0e0561-4e59-406b-aeb5-1787130dd8de tempest-TaggedAttachmentsTest-1741614252 None] Lock "cinder-1d022dff-f14c-490f-ab18-6470a43d7a4b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:26:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fc0e0561-4e59-406b-aeb5-1787130dd8de tempest-TaggedAttachmentsTest-1741614252 None] Acquiring lock "cinder-quobyte-1d022dff-f14c-490f-ab18-6470a43d7a4b" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:26:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fc0e0561-4e59-406b-aeb5-1787130dd8de tempest-TaggedAttachmentsTest-1741614252 None] Lock "cinder-quobyte-1d022dff-f14c-490f-ab18-6470a43d7a4b" acquired by "delete_volume" :: waited 0.025s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:26:35 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eacdab0-53e8-4d0a-a065-30b001c35061]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:26:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fc0e0561-4e59-406b-aeb5-1787130dd8de tempest-TaggedAttachmentsTest-1741614252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1d022dff-f14c-490f-ab18-6470a43d7a4b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:26:36 devstack sudo[89975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1d022dff-f14c-490f-ab18-6470a43d7a4b Jul 06 15:26:36 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:26:36 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root Jul 06 15:26:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fc0e0561-4e59-406b-aeb5-1787130dd8de tempest-TaggedAttachmentsTest-1741614252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1d022dff-f14c-490f-ab18-6470a43d7a4b" returned: 0 in 0.919s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:26:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fc0e0561-4e59-406b-aeb5-1787130dd8de tempest-TaggedAttachmentsTest-1741614252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1d022dff-f14c-490f-ab18-6470a43d7a4b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:26:36 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1d022dff-f14c-490f-ab18-6470a43d7a4b Jul 06 15:26:36 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:26:37 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Jul 06 15:26:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fc0e0561-4e59-406b-aeb5-1787130dd8de tempest-TaggedAttachmentsTest-1741614252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1d022dff-f14c-490f-ab18-6470a43d7a4b" returned: 0 in 0.880s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:26:37 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fc0e0561-4e59-406b-aeb5-1787130dd8de tempest-TaggedAttachmentsTest-1741614252 None] Lock "cinder-quobyte-1d022dff-f14c-490f-ab18-6470a43d7a4b" released by "delete_volume" :: held 1.866s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:26:37 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-fc0e0561-4e59-406b-aeb5-1787130dd8de tempest-TaggedAttachmentsTest-1741614252 None] Created reservations ['9151a64a-1a6e-4a0c-8105-425ad4f8d067', 'd9d09ec7-f985-41f6-a837-b924b9124024', 'a713703c-7d63-4054-acce-5c089b6bc7a9', 'a04735c8-8042-43cb-8d46-fa8432003045'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:26:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fc0e0561-4e59-406b-aeb5-1787130dd8de tempest-TaggedAttachmentsTest-1741614252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:26:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fc0e0561-4e59-406b-aeb5-1787130dd8de tempest-TaggedAttachmentsTest-1741614252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:26:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fc0e0561-4e59-406b-aeb5-1787130dd8de tempest-TaggedAttachmentsTest-1741614252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:26:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fc0e0561-4e59-406b-aeb5-1787130dd8de tempest-TaggedAttachmentsTest-1741614252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:26:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fc0e0561-4e59-406b-aeb5-1787130dd8de tempest-TaggedAttachmentsTest-1741614252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:26:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fc0e0561-4e59-406b-aeb5-1787130dd8de tempest-TaggedAttachmentsTest-1741614252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:26:38 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:26:38 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:26:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:26:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:26:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:26:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:26:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:26:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:26:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:26:38 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:26:38 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:26:38 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Jul 06 15:26:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fc0e0561-4e59-406b-aeb5-1787130dd8de tempest-TaggedAttachmentsTest-1741614252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.726s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:26:38 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-fc0e0561-4e59-406b-aeb5-1787130dd8de tempest-TaggedAttachmentsTest-1741614252 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:26:38 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-fc0e0561-4e59-406b-aeb5-1787130dd8de tempest-TaggedAttachmentsTest-1741614252 None] Deleted volume successfully. Jul 06 15:26:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fc0e0561-4e59-406b-aeb5-1787130dd8de tempest-TaggedAttachmentsTest-1741614252 None] Lock "cinder-1d022dff-f14c-490f-ab18-6470a43d7a4b-delete_volume" released by "delete_volume" :: held 2.997s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:26:39 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Jul 06 15:26:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.765s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:26:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:26:48 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:26:58 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=1 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:26:58 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=4,cinder:INSERT=3,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:27:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-65821ba0-9ef5-406c-bf30-b0328f9f7569 tempest-AttachVolumeShelveTestJSON-932883443 None] Acquiring lock "cinder-a5f56b04-7909-4301-9ff6-ef867bceb4c3-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:27:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-65821ba0-9ef5-406c-bf30-b0328f9f7569 tempest-AttachVolumeShelveTestJSON-932883443 None] Lock "cinder-a5f56b04-7909-4301-9ff6-ef867bceb4c3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:27:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-65821ba0-9ef5-406c-bf30-b0328f9f7569 tempest-AttachVolumeShelveTestJSON-932883443 None] Acquiring lock "cinder-quobyte-a5f56b04-7909-4301-9ff6-ef867bceb4c3" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:27:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-65821ba0-9ef5-406c-bf30-b0328f9f7569 tempest-AttachVolumeShelveTestJSON-932883443 None] Lock "cinder-quobyte-a5f56b04-7909-4301-9ff6-ef867bceb4c3" acquired by "delete_volume" :: waited 0.021s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:27:29 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[3428dc76-ca47-4c6e-9621-e6ed7c578e52]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:27:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-65821ba0-9ef5-406c-bf30-b0328f9f7569 tempest-AttachVolumeShelveTestJSON-932883443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a5f56b04-7909-4301-9ff6-ef867bceb4c3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:29 devstack sudo[90477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a5f56b04-7909-4301-9ff6-ef867bceb4c3 Jul 06 15:27:29 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:30 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:27:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Flow 'volume_create_manager' (7550a96c-534b-4d69-a8ee-89d18ccf3af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:27:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a1719d-7efa-43f0-a798-d2eeec15de33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a1719d-7efa-43f0-a798-d2eeec15de33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-322268449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=516cc1c4-6a1f-4894-8b4e-d03f122a162c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1398d8b933fd4cf6a3afad2548eee617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:27:30Z,use_quota=True,user_id='aa21e3289b9445a9a83df85ca6309f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d23c6307-aaff-4548-98de-aca1f17274b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d23c6307-aaff-4548-98de-aca1f17274b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a506cfef-44ad-4522-a7e0-7151f74fe5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a506cfef-44ad-4522-a7e0-7151f74fe5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '516cc1c4-6a1f-4894-8b4e-d03f122a162c', 'volume_name': 'volume-516cc1c4-6a1f-4894-8b4e-d03f122a162c', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb1b741-71e6-4f49-9604-3dac78109c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb1b741-71e6-4f49-9604-3dac78109c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754b039d-a8a0-4035-a36b-8e624743bfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:30 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Volume 516cc1c4-6a1f-4894-8b4e-d03f122a162c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-516cc1c4-6a1f-4894-8b4e-d03f122a162c', 'volume_size': 1} Jul 06 15:27:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:27:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:27:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-322268449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=516cc1c4-6a1f-4894-8b4e-d03f122a162c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1398d8b933fd4cf6a3afad2548eee617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:27:30Z,use_quota=True,user_id='aa21e3289b9445a9a83df85ca6309f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:27:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Creating volume 516cc1c4-6a1f-4894-8b4e-d03f122a162c {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:27:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:27:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:27:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:27:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:27:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:27:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:27:30 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:27:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-516cc1c4-6a1f-4894-8b4e-d03f122a162c 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:30 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-516cc1c4-6a1f-4894-8b4e-d03f122a162c 1073741824 Jul 06 15:27:30 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:31 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-65821ba0-9ef5-406c-bf30-b0328f9f7569 tempest-AttachVolumeShelveTestJSON-932883443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a5f56b04-7909-4301-9ff6-ef867bceb4c3" returned: 0 in 1.253s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-65821ba0-9ef5-406c-bf30-b0328f9f7569 tempest-AttachVolumeShelveTestJSON-932883443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a5f56b04-7909-4301-9ff6-ef867bceb4c3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:31 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a5f56b04-7909-4301-9ff6-ef867bceb4c3 Jul 06 15:27:31 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:31 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-516cc1c4-6a1f-4894-8b4e-d03f122a162c 1073741824" returned: 0 in 0.994s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-516cc1c4-6a1f-4894-8b4e-d03f122a162c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:31 devstack sudo[90527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-516cc1c4-6a1f-4894-8b4e-d03f122a162c Jul 06 15:27:31 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-65821ba0-9ef5-406c-bf30-b0328f9f7569 tempest-AttachVolumeShelveTestJSON-932883443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a5f56b04-7909-4301-9ff6-ef867bceb4c3" returned: 0 in 0.821s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:31 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:31 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-65821ba0-9ef5-406c-bf30-b0328f9f7569 tempest-AttachVolumeShelveTestJSON-932883443 None] Lock "cinder-quobyte-a5f56b04-7909-4301-9ff6-ef867bceb4c3" released by "delete_volume" :: held 2.178s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:27:32 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-65821ba0-9ef5-406c-bf30-b0328f9f7569 tempest-AttachVolumeShelveTestJSON-932883443 None] Created reservations ['dc16e05f-6ac8-4e4b-8aa5-b29fa97b2668', '5d22d6a3-3aff-4fb8-8f62-156480bdfbbd', 'fd28821f-9b41-4675-8341-9d8bbffa1970', '845e4fb5-05b4-4d34-b700-784ba93ea4b9'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:27:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-65821ba0-9ef5-406c-bf30-b0328f9f7569 tempest-AttachVolumeShelveTestJSON-932883443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:27:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-65821ba0-9ef5-406c-bf30-b0328f9f7569 tempest-AttachVolumeShelveTestJSON-932883443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:27:32 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-65821ba0-9ef5-406c-bf30-b0328f9f7569 tempest-AttachVolumeShelveTestJSON-932883443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:27:32 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-65821ba0-9ef5-406c-bf30-b0328f9f7569 tempest-AttachVolumeShelveTestJSON-932883443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:27:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-65821ba0-9ef5-406c-bf30-b0328f9f7569 tempest-AttachVolumeShelveTestJSON-932883443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:27:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-65821ba0-9ef5-406c-bf30-b0328f9f7569 tempest-AttachVolumeShelveTestJSON-932883443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:32 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:27:32 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:33 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-516cc1c4-6a1f-4894-8b4e-d03f122a162c" returned: 0 in 1.656s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] <== create_volume: return (2713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:27:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.716s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:27:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754b039d-a8a0-4035-a36b-8e624743bfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-516cc1c4-6a1f-4894-8b4e-d03f122a162c', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d65affd-d4e5-48c3-bb33-8ada5cee4dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:33 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Volume volume-516cc1c4-6a1f-4894-8b4e-d03f122a162c (516cc1c4-6a1f-4894-8b4e-d03f122a162c): created successfully Jul 06 15:27:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d65affd-d4e5-48c3-bb33-8ada5cee4dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Flow 'volume_create_manager' (7550a96c-534b-4d69-a8ee-89d18ccf3af0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:27:33 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-483ef54b-9bcd-43cc-a598-07381b5b248d tempest-VolumesActionsTest-1370696701 None] Created volume successfully. Jul 06 15:27:33 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-65821ba0-9ef5-406c-bf30-b0328f9f7569 tempest-AttachVolumeShelveTestJSON-932883443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.512s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:33 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-65821ba0-9ef5-406c-bf30-b0328f9f7569 tempest-AttachVolumeShelveTestJSON-932883443 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:27:33 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e3469902-3f43-4dbd-8242-f6e115a19b69 tempest-VolumesActionsTest-1370696701 None] Acquiring lock "cinder-516cc1c4-6a1f-4894-8b4e-d03f122a162c" by "attach_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:27:33 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-65821ba0-9ef5-406c-bf30-b0328f9f7569 tempest-AttachVolumeShelveTestJSON-932883443 None] Deleted volume successfully. Jul 06 15:27:33 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e3469902-3f43-4dbd-8242-f6e115a19b69 tempest-VolumesActionsTest-1370696701 None] Lock "cinder-516cc1c4-6a1f-4894-8b4e-d03f122a162c" acquired by "attach_volume" :: waited 0.064s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:27:33 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-65821ba0-9ef5-406c-bf30-b0328f9f7569 tempest-AttachVolumeShelveTestJSON-932883443 None] Lock "cinder-a5f56b04-7909-4301-9ff6-ef867bceb4c3-delete_volume" released by "delete_volume" :: held 4.199s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:27:34 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-e3469902-3f43-4dbd-8242-f6e115a19b69 tempest-VolumesActionsTest-1370696701 None] Attaching volume 516cc1c4-6a1f-4894-8b4e-d03f122a162c to instance 523f8972-3751-4aa5-a0bd-97dbee533faf at mountpoint /dev/vdb on host None. Jul 06 15:27:34 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-e3469902-3f43-4dbd-8242-f6e115a19b69 tempest-VolumesActionsTest-1370696701 None] Attach volume completed successfully. Jul 06 15:27:34 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e3469902-3f43-4dbd-8242-f6e115a19b69 tempest-VolumesActionsTest-1370696701 None] Lock "cinder-516cc1c4-6a1f-4894-8b4e-d03f122a162c" released by "attach_volume" :: held 0.196s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:27:35 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-7f6fb51e-269e-46c6-a215-044725ba619d tempest-VolumesActionsTest-1418965030 None] Terminate volume connection completed successfully. Jul 06 15:27:36 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:27:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Flow 'volume_create_manager' (29674d7c-b035-4fdc-bf17-1f5654cc07b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:27:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1267106f-39f9-4851-921f-158af2cc1451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1267106f-39f9-4851-921f-158af2cc1451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1362058207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16e8f0cb-23ee-4ff8-a5cb-46589de375b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7111c41c7a4e55aa74509d7393ab8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:27:36Z,use_quota=True,user_id='1dd3dde178294812991dab8a04b4c6f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (824211a6-0f44-4a57-87d3-45ef11bb2a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (824211a6-0f44-4a57-87d3-45ef11bb2a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2862284-4f62-4a2b-90f1-720ccdbd164d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2862284-4f62-4a2b-90f1-720ccdbd164d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16e8f0cb-23ee-4ff8-a5cb-46589de375b6', 'volume_name': 'volume-16e8f0cb-23ee-4ff8-a5cb-46589de375b6', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09c7e35-c867-4cd7-9ea8-c32bb8c17696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09c7e35-c867-4cd7-9ea8-c32bb8c17696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1ff166b-8f78-4bd8-b6d5-8fb17bbd4a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:36 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Volume 16e8f0cb-23ee-4ff8-a5cb-46589de375b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16e8f0cb-23ee-4ff8-a5cb-46589de375b6', 'volume_size': 1} Jul 06 15:27:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:27:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:27:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1362058207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16e8f0cb-23ee-4ff8-a5cb-46589de375b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7111c41c7a4e55aa74509d7393ab8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:27:36Z,use_quota=True,user_id='1dd3dde178294812991dab8a04b4c6f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:27:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Creating volume 16e8f0cb-23ee-4ff8-a5cb-46589de375b6 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:27:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:27:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:27:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:27:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:27:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:27:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:27:36 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:27:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-16e8f0cb-23ee-4ff8-a5cb-46589de375b6 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:36 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-16e8f0cb-23ee-4ff8-a5cb-46589de375b6 1073741824 Jul 06 15:27:36 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-7f6fb51e-269e-46c6-a215-044725ba619d tempest-VolumesActionsTest-1418965030 None] Acquiring lock "cinder-516cc1c4-6a1f-4894-8b4e-d03f122a162c-detach_volume" by "detach_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:27:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-7f6fb51e-269e-46c6-a215-044725ba619d tempest-VolumesActionsTest-1418965030 None] Lock "cinder-516cc1c4-6a1f-4894-8b4e-d03f122a162c-detach_volume" acquired by "detach_volume" :: waited 0.105s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:27:36 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-7f6fb51e-269e-46c6-a215-044725ba619d tempest-VolumesActionsTest-1418965030 None] Detaching volume 516cc1c4-6a1f-4894-8b4e-d03f122a162c from instance 523f8972-3751-4aa5-a0bd-97dbee533faf. Jul 06 15:27:36 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-7f6fb51e-269e-46c6-a215-044725ba619d tempest-VolumesActionsTest-1418965030 None] Detach volume completed successfully. Jul 06 15:27:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-7f6fb51e-269e-46c6-a215-044725ba619d tempest-VolumesActionsTest-1418965030 None] Lock "cinder-516cc1c4-6a1f-4894-8b4e-d03f122a162c-detach_volume" released by "detach_volume" :: held 0.213s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:27:37 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-da89ffb3-9413-4d14-8206-58f45c1ae4d9 tempest-VolumesActionsTest-1370696701 None] Acquiring lock "cinder-516cc1c4-6a1f-4894-8b4e-d03f122a162c-detach_volume" by "detach_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:27:37 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-da89ffb3-9413-4d14-8206-58f45c1ae4d9 tempest-VolumesActionsTest-1370696701 None] Lock "cinder-516cc1c4-6a1f-4894-8b4e-d03f122a162c-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:27:37 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-da89ffb3-9413-4d14-8206-58f45c1ae4d9 tempest-VolumesActionsTest-1370696701 None] Volume detach called, but volume not attached. Jul 06 15:27:37 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-da89ffb3-9413-4d14-8206-58f45c1ae4d9 tempest-VolumesActionsTest-1370696701 None] Lock "cinder-516cc1c4-6a1f-4894-8b4e-d03f122a162c-detach_volume" released by "detach_volume" :: held 0.035s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:27:37 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-16e8f0cb-23ee-4ff8-a5cb-46589de375b6 1073741824" returned: 0 in 1.824s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-16e8f0cb-23ee-4ff8-a5cb-46589de375b6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:38 devstack sudo[90616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-16e8f0cb-23ee-4ff8-a5cb-46589de375b6 Jul 06 15:27:38 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8cb7ef5c-438c-4ea8-b669-999844fa07d9 tempest-VolumesActionsTest-1370696701 None] Acquiring lock "cinder-516cc1c4-6a1f-4894-8b4e-d03f122a162c-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:27:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8cb7ef5c-438c-4ea8-b669-999844fa07d9 tempest-VolumesActionsTest-1370696701 None] Lock "cinder-516cc1c4-6a1f-4894-8b4e-d03f122a162c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:27:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8cb7ef5c-438c-4ea8-b669-999844fa07d9 tempest-VolumesActionsTest-1370696701 None] Acquiring lock "cinder-quobyte-516cc1c4-6a1f-4894-8b4e-d03f122a162c" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:27:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:27:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:27:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:27:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:27:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:27:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:27:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8cb7ef5c-438c-4ea8-b669-999844fa07d9 tempest-VolumesActionsTest-1370696701 None] Lock "cinder-quobyte-516cc1c4-6a1f-4894-8b4e-d03f122a162c" acquired by "delete_volume" :: waited 0.099s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:27:38 devstack sudo[90618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:27:38 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:38 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9da0d6-9d5b-407f-8ddc-b661723eeac3]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:27:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8cb7ef5c-438c-4ea8-b669-999844fa07d9 tempest-VolumesActionsTest-1370696701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-516cc1c4-6a1f-4894-8b4e-d03f122a162c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:38 devstack sudo[90620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-516cc1c4-6a1f-4894-8b4e-d03f122a162c Jul 06 15:27:38 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:39 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.354s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:27:39 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager._thread_info {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:27:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread count: 8 {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:27:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread info: [<_MainThread(MainThread, started 124857273856128)>, , , , , , , ] {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:27:40 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8cb7ef5c-438c-4ea8-b669-999844fa07d9 tempest-VolumesActionsTest-1370696701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-516cc1c4-6a1f-4894-8b4e-d03f122a162c" returned: 0 in 1.999s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8cb7ef5c-438c-4ea8-b669-999844fa07d9 tempest-VolumesActionsTest-1370696701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-516cc1c4-6a1f-4894-8b4e-d03f122a162c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:40 devstack sudo[90636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-516cc1c4-6a1f-4894-8b4e-d03f122a162c Jul 06 15:27:40 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:40 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-16e8f0cb-23ee-4ff8-a5cb-46589de375b6" returned: 0 in 2.633s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] <== create_volume: return (4569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:27:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.572s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:27:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1ff166b-8f78-4bd8-b6d5-8fb17bbd4a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16e8f0cb-23ee-4ff8-a5cb-46589de375b6', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (173d1452-d732-472e-85f4-e0be5ec296ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:40 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Volume volume-16e8f0cb-23ee-4ff8-a5cb-46589de375b6 (16e8f0cb-23ee-4ff8-a5cb-46589de375b6): created successfully Jul 06 15:27:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (173d1452-d732-472e-85f4-e0be5ec296ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Flow 'volume_create_manager' (29674d7c-b035-4fdc-bf17-1f5654cc07b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:27:40 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-c7c33bf5-4efb-4bd6-9527-7267cfa91461 tempest-ServersNegativeTestJSON-516792136 None] Created volume successfully. Jul 06 15:27:41 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8cb7ef5c-438c-4ea8-b669-999844fa07d9 tempest-VolumesActionsTest-1370696701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-516cc1c4-6a1f-4894-8b4e-d03f122a162c" returned: 0 in 1.009s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8cb7ef5c-438c-4ea8-b669-999844fa07d9 tempest-VolumesActionsTest-1370696701 None] Lock "cinder-quobyte-516cc1c4-6a1f-4894-8b4e-d03f122a162c" released by "delete_volume" :: held 3.154s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:27:41 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-8cb7ef5c-438c-4ea8-b669-999844fa07d9 tempest-VolumesActionsTest-1370696701 None] Created reservations ['97a5cbf4-d25d-45bd-b5ad-93fd01b9a124', '57bdd5cf-d094-4ba4-9e14-98b239b8e203', 'e1327803-2541-411a-9961-e4422a71cecf', '097ec5ef-c0d2-4e37-b26d-220ba4ec1f3b'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:27:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8cb7ef5c-438c-4ea8-b669-999844fa07d9 tempest-VolumesActionsTest-1370696701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:27:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8cb7ef5c-438c-4ea8-b669-999844fa07d9 tempest-VolumesActionsTest-1370696701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:27:41 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-8cb7ef5c-438c-4ea8-b669-999844fa07d9 tempest-VolumesActionsTest-1370696701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:27:41 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-8cb7ef5c-438c-4ea8-b669-999844fa07d9 tempest-VolumesActionsTest-1370696701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:27:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8cb7ef5c-438c-4ea8-b669-999844fa07d9 tempest-VolumesActionsTest-1370696701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:27:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8cb7ef5c-438c-4ea8-b669-999844fa07d9 tempest-VolumesActionsTest-1370696701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:41 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:27:41 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:43 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8cb7ef5c-438c-4ea8-b669-999844fa07d9 tempest-VolumesActionsTest-1370696701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.246s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:43 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-8cb7ef5c-438c-4ea8-b669-999844fa07d9 tempest-VolumesActionsTest-1370696701 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:27:43 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-8cb7ef5c-438c-4ea8-b669-999844fa07d9 tempest-VolumesActionsTest-1370696701 None] Deleted volume successfully. Jul 06 15:27:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8cb7ef5c-438c-4ea8-b669-999844fa07d9 tempest-VolumesActionsTest-1370696701 None] Lock "cinder-516cc1c4-6a1f-4894-8b4e-d03f122a162c-delete_volume" released by "delete_volume" :: held 4.853s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:27:43 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:27:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Flow 'volume_create_manager' (a40b879a-b25a-4324-a506-73cdf567985e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:27:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6c5a44-15c8-4dc1-8216-360c8e9bb6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6c5a44-15c8-4dc1-8216-360c8e9bb6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-849321298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da71cbab-6d04-4fa0-b965-2465cf42200b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7111c41c7a4e55aa74509d7393ab8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:27:44Z,use_quota=True,user_id='1dd3dde178294812991dab8a04b4c6f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d00f52-b871-4648-8ffd-95840c81ae16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d00f52-b871-4648-8ffd-95840c81ae16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229bd8a2-ce65-4465-8235-afa0954fbc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229bd8a2-ce65-4465-8235-afa0954fbc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da71cbab-6d04-4fa0-b965-2465cf42200b', 'volume_name': 'volume-da71cbab-6d04-4fa0-b965-2465cf42200b', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87be600d-eaac-4040-a58e-16e2db2ae7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87be600d-eaac-4040-a58e-16e2db2ae7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ca2ff5b-e3b6-4701-add4-8985df69291b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:43 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Volume da71cbab-6d04-4fa0-b965-2465cf42200b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da71cbab-6d04-4fa0-b965-2465cf42200b', 'volume_size': 1} Jul 06 15:27:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:27:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:27:43 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-849321298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da71cbab-6d04-4fa0-b965-2465cf42200b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7111c41c7a4e55aa74509d7393ab8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:27:44Z,use_quota=True,user_id='1dd3dde178294812991dab8a04b4c6f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:27:43 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Creating volume da71cbab-6d04-4fa0-b965-2465cf42200b {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:27:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:27:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:27:43 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:27:43 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:27:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:27:43 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:27:43 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:27:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da71cbab-6d04-4fa0-b965-2465cf42200b 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:43 devstack sudo[90658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da71cbab-6d04-4fa0-b965-2465cf42200b 1073741824 Jul 06 15:27:43 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:45 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da71cbab-6d04-4fa0-b965-2465cf42200b 1073741824" returned: 0 in 1.634s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da71cbab-6d04-4fa0-b965-2465cf42200b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:45 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da71cbab-6d04-4fa0-b965-2465cf42200b Jul 06 15:27:45 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:46 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da71cbab-6d04-4fa0-b965-2465cf42200b" returned: 0 in 0.832s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] <== create_volume: return (2545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:27:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.548s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:27:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ca2ff5b-e3b6-4701-add4-8985df69291b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da71cbab-6d04-4fa0-b965-2465cf42200b', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6bf97b1-0c28-421d-a4dc-c3c686bc2f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:46 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Volume volume-da71cbab-6d04-4fa0-b965-2465cf42200b (da71cbab-6d04-4fa0-b965-2465cf42200b): created successfully Jul 06 15:27:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6bf97b1-0c28-421d-a4dc-c3c686bc2f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Flow 'volume_create_manager' (a40b879a-b25a-4324-a506-73cdf567985e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:27:46 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-b5fea316-ea28-431d-8cfc-bc43ccf9db8c tempest-ServersNegativeTestJSON-516792136 None] Created volume successfully. Jul 06 15:27:47 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4f8d68a6-044a-45cf-8908-31b873cc5c23 tempest-ServersNegativeTestJSON-516792136 None] Acquiring lock "cinder-da71cbab-6d04-4fa0-b965-2465cf42200b-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:27:47 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4f8d68a6-044a-45cf-8908-31b873cc5c23 tempest-ServersNegativeTestJSON-516792136 None] Lock "cinder-da71cbab-6d04-4fa0-b965-2465cf42200b-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:27:47 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4f8d68a6-044a-45cf-8908-31b873cc5c23 tempest-ServersNegativeTestJSON-516792136 None] Acquiring lock "cinder-quobyte-da71cbab-6d04-4fa0-b965-2465cf42200b" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:27:47 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4f8d68a6-044a-45cf-8908-31b873cc5c23 tempest-ServersNegativeTestJSON-516792136 None] Lock "cinder-quobyte-da71cbab-6d04-4fa0-b965-2465cf42200b" acquired by "delete_volume" :: waited 0.021s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:27:47 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61947c4-2a3d-410f-a504-4d78099c72f4]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:27:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4f8d68a6-044a-45cf-8908-31b873cc5c23 tempest-ServersNegativeTestJSON-516792136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da71cbab-6d04-4fa0-b965-2465cf42200b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:48 devstack sudo[90706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da71cbab-6d04-4fa0-b965-2465cf42200b Jul 06 15:27:48 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:48 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4f8d68a6-044a-45cf-8908-31b873cc5c23 tempest-ServersNegativeTestJSON-516792136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da71cbab-6d04-4fa0-b965-2465cf42200b" returned: 0 in 0.845s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4f8d68a6-044a-45cf-8908-31b873cc5c23 tempest-ServersNegativeTestJSON-516792136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da71cbab-6d04-4fa0-b965-2465cf42200b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:48 devstack sudo[90712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da71cbab-6d04-4fa0-b965-2465cf42200b Jul 06 15:27:48 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:49 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4f8d68a6-044a-45cf-8908-31b873cc5c23 tempest-ServersNegativeTestJSON-516792136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da71cbab-6d04-4fa0-b965-2465cf42200b" returned: 0 in 0.957s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:49 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4f8d68a6-044a-45cf-8908-31b873cc5c23 tempest-ServersNegativeTestJSON-516792136 None] Lock "cinder-quobyte-da71cbab-6d04-4fa0-b965-2465cf42200b" released by "delete_volume" :: held 1.878s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:27:49 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-4f8d68a6-044a-45cf-8908-31b873cc5c23 tempest-ServersNegativeTestJSON-516792136 None] Created reservations ['6ea9232c-30a3-43df-9412-739850193e0f', '48335724-7236-4d18-a4a4-4a14d6542eb4', '1d8ff616-4959-4cb7-b0d3-2bd455f38553', '6c052f5e-1be8-4f14-93b5-1aa4e37a66de'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:27:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4f8d68a6-044a-45cf-8908-31b873cc5c23 tempest-ServersNegativeTestJSON-516792136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:27:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4f8d68a6-044a-45cf-8908-31b873cc5c23 tempest-ServersNegativeTestJSON-516792136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:27:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4f8d68a6-044a-45cf-8908-31b873cc5c23 tempest-ServersNegativeTestJSON-516792136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:27:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4f8d68a6-044a-45cf-8908-31b873cc5c23 tempest-ServersNegativeTestJSON-516792136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:27:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4f8d68a6-044a-45cf-8908-31b873cc5c23 tempest-ServersNegativeTestJSON-516792136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:27:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4f8d68a6-044a-45cf-8908-31b873cc5c23 tempest-ServersNegativeTestJSON-516792136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:49 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:27:49 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:50 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6f0e7a16-298e-4665-9071-d5152bc7f904 tempest-ServersNegativeTestJSON-516792136 None] Acquiring lock "cinder-16e8f0cb-23ee-4ff8-a5cb-46589de375b6-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:27:50 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6f0e7a16-298e-4665-9071-d5152bc7f904 tempest-ServersNegativeTestJSON-516792136 None] Lock "cinder-16e8f0cb-23ee-4ff8-a5cb-46589de375b6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:27:50 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6f0e7a16-298e-4665-9071-d5152bc7f904 tempest-ServersNegativeTestJSON-516792136 None] Acquiring lock "cinder-quobyte-16e8f0cb-23ee-4ff8-a5cb-46589de375b6" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:27:50 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6f0e7a16-298e-4665-9071-d5152bc7f904 tempest-ServersNegativeTestJSON-516792136 None] Lock "cinder-quobyte-16e8f0cb-23ee-4ff8-a5cb-46589de375b6" acquired by "delete_volume" :: waited 0.027s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:27:50 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2aaf4ff-5e46-401e-a879-ef14d39b65e6]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:27:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6f0e7a16-298e-4665-9071-d5152bc7f904 tempest-ServersNegativeTestJSON-516792136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-16e8f0cb-23ee-4ff8-a5cb-46589de375b6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:50 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-16e8f0cb-23ee-4ff8-a5cb-46589de375b6 Jul 06 15:27:50 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:51 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4f8d68a6-044a-45cf-8908-31b873cc5c23 tempest-ServersNegativeTestJSON-516792136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.208s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:51 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-4f8d68a6-044a-45cf-8908-31b873cc5c23 tempest-ServersNegativeTestJSON-516792136 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:27:51 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-4f8d68a6-044a-45cf-8908-31b873cc5c23 tempest-ServersNegativeTestJSON-516792136 None] Deleted volume successfully. Jul 06 15:27:51 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4f8d68a6-044a-45cf-8908-31b873cc5c23 tempest-ServersNegativeTestJSON-516792136 None] Lock "cinder-da71cbab-6d04-4fa0-b965-2465cf42200b-delete_volume" released by "delete_volume" :: held 3.384s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:27:51 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:27:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Flow 'volume_create_manager' (8f65b11c-80a0-4650-825b-c3710918f201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:27:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a66ddde-67e0-47ac-a7b5-b0712f8a9c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a66ddde-67e0-47ac-a7b5-b0712f8a9c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2108978416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0849f070-7d53-4c65-bf22-bb88940cc2c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1398d8b933fd4cf6a3afad2548eee617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:27:51Z,use_quota=True,user_id='aa21e3289b9445a9a83df85ca6309f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76fa4a2-e0a5-4944-9dce-eb8501291f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76fa4a2-e0a5-4944-9dce-eb8501291f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d06bea42-d609-4514-a5bb-4f7bce317349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d06bea42-d609-4514-a5bb-4f7bce317349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0849f070-7d53-4c65-bf22-bb88940cc2c8', 'volume_name': 'volume-0849f070-7d53-4c65-bf22-bb88940cc2c8', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1394848d-90cc-4dff-bc08-ae914311d779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1394848d-90cc-4dff-bc08-ae914311d779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0310901d-f90f-4bd7-a775-87f4d77a66a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:51 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Volume 0849f070-7d53-4c65-bf22-bb88940cc2c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0849f070-7d53-4c65-bf22-bb88940cc2c8', 'volume_size': 1} Jul 06 15:27:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:27:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:27:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2108978416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0849f070-7d53-4c65-bf22-bb88940cc2c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1398d8b933fd4cf6a3afad2548eee617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:27:51Z,use_quota=True,user_id='aa21e3289b9445a9a83df85ca6309f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:27:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Creating volume 0849f070-7d53-4c65-bf22-bb88940cc2c8 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:27:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:27:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:27:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:27:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:27:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:27:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:27:51 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:27:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0849f070-7d53-4c65-bf22-bb88940cc2c8 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:51 devstack sudo[90744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0849f070-7d53-4c65-bf22-bb88940cc2c8 1073741824 Jul 06 15:27:51 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:51 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6f0e7a16-298e-4665-9071-d5152bc7f904 tempest-ServersNegativeTestJSON-516792136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-16e8f0cb-23ee-4ff8-a5cb-46589de375b6" returned: 0 in 1.070s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6f0e7a16-298e-4665-9071-d5152bc7f904 tempest-ServersNegativeTestJSON-516792136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-16e8f0cb-23ee-4ff8-a5cb-46589de375b6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:51 devstack sudo[90746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-16e8f0cb-23ee-4ff8-a5cb-46589de375b6 Jul 06 15:27:51 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:51 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6f0e7a16-298e-4665-9071-d5152bc7f904 tempest-ServersNegativeTestJSON-516792136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-16e8f0cb-23ee-4ff8-a5cb-46589de375b6" returned: 0 in 0.633s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:52 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6f0e7a16-298e-4665-9071-d5152bc7f904 tempest-ServersNegativeTestJSON-516792136 None] Lock "cinder-quobyte-16e8f0cb-23ee-4ff8-a5cb-46589de375b6" released by "delete_volume" :: held 1.783s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:27:52 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-6f0e7a16-298e-4665-9071-d5152bc7f904 tempest-ServersNegativeTestJSON-516792136 None] Created reservations ['01b04f60-80dd-4e11-a9b9-2d92f9a6c0a0', '7bfb0788-9d00-411f-8f23-780c38246c75', '68b0d734-740e-400b-ae92-9f33c087669a', 'd634d811-1d88-4e73-85ab-61dcb519e66f'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:27:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6f0e7a16-298e-4665-9071-d5152bc7f904 tempest-ServersNegativeTestJSON-516792136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:27:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6f0e7a16-298e-4665-9071-d5152bc7f904 tempest-ServersNegativeTestJSON-516792136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:27:52 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6f0e7a16-298e-4665-9071-d5152bc7f904 tempest-ServersNegativeTestJSON-516792136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:27:52 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6f0e7a16-298e-4665-9071-d5152bc7f904 tempest-ServersNegativeTestJSON-516792136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:27:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6f0e7a16-298e-4665-9071-d5152bc7f904 tempest-ServersNegativeTestJSON-516792136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:27:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6f0e7a16-298e-4665-9071-d5152bc7f904 tempest-ServersNegativeTestJSON-516792136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:52 devstack sudo[90759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:27:52 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:52 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0849f070-7d53-4c65-bf22-bb88940cc2c8 1073741824" returned: 0 in 1.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0849f070-7d53-4c65-bf22-bb88940cc2c8 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:52 devstack sudo[90761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0849f070-7d53-4c65-bf22-bb88940cc2c8 Jul 06 15:27:52 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:53 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6f0e7a16-298e-4665-9071-d5152bc7f904 tempest-ServersNegativeTestJSON-516792136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.809s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:53 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-6f0e7a16-298e-4665-9071-d5152bc7f904 tempest-ServersNegativeTestJSON-516792136 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:27:53 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-6f0e7a16-298e-4665-9071-d5152bc7f904 tempest-ServersNegativeTestJSON-516792136 None] Deleted volume successfully. Jul 06 15:27:53 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6f0e7a16-298e-4665-9071-d5152bc7f904 tempest-ServersNegativeTestJSON-516792136 None] Lock "cinder-16e8f0cb-23ee-4ff8-a5cb-46589de375b6-delete_volume" released by "delete_volume" :: held 2.904s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:27:53 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0849f070-7d53-4c65-bf22-bb88940cc2c8" returned: 0 in 0.884s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:53 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:27:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:27:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0310901d-f90f-4bd7-a775-87f4d77a66a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0849f070-7d53-4c65-bf22-bb88940cc2c8', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebbe3226-4279-4219-b329-dcd81617fd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:53 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Volume volume-0849f070-7d53-4c65-bf22-bb88940cc2c8 (0849f070-7d53-4c65-bf22-bb88940cc2c8): created successfully Jul 06 15:27:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebbe3226-4279-4219-b329-dcd81617fd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Flow 'volume_create_manager' (8f65b11c-80a0-4650-825b-c3710918f201) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:27:53 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-377f62f7-7390-4277-a079-bba49efc3de1 tempest-VolumesActionsTest-1370696701 None] Created volume successfully. Jul 06 15:27:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ec1a684d-5c2b-450a-bb64-d7dfe820365a tempest-VolumesActionsTest-1418965030 None] Acquiring lock "cinder-0849f070-7d53-4c65-bf22-bb88940cc2c8-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:27:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ec1a684d-5c2b-450a-bb64-d7dfe820365a tempest-VolumesActionsTest-1418965030 None] Lock "cinder-0849f070-7d53-4c65-bf22-bb88940cc2c8-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:27:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ec1a684d-5c2b-450a-bb64-d7dfe820365a tempest-VolumesActionsTest-1418965030 None] Acquiring lock "cinder-quobyte-0849f070-7d53-4c65-bf22-bb88940cc2c8" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:27:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ec1a684d-5c2b-450a-bb64-d7dfe820365a tempest-VolumesActionsTest-1418965030 None] Lock "cinder-quobyte-0849f070-7d53-4c65-bf22-bb88940cc2c8" acquired by "delete_volume" :: waited 0.052s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:27:54 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f4830b-0198-4f82-8a81-7de5574ac71a]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:27:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ec1a684d-5c2b-450a-bb64-d7dfe820365a tempest-VolumesActionsTest-1418965030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0849f070-7d53-4c65-bf22-bb88940cc2c8 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:54 devstack sudo[90783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0849f070-7d53-4c65-bf22-bb88940cc2c8 Jul 06 15:27:54 devstack sudo[90783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:55 devstack sudo[90783]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ec1a684d-5c2b-450a-bb64-d7dfe820365a tempest-VolumesActionsTest-1418965030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0849f070-7d53-4c65-bf22-bb88940cc2c8" returned: 0 in 0.818s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ec1a684d-5c2b-450a-bb64-d7dfe820365a tempest-VolumesActionsTest-1418965030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0849f070-7d53-4c65-bf22-bb88940cc2c8 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:55 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0849f070-7d53-4c65-bf22-bb88940cc2c8 Jul 06 15:27:55 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:56 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ec1a684d-5c2b-450a-bb64-d7dfe820365a tempest-VolumesActionsTest-1418965030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0849f070-7d53-4c65-bf22-bb88940cc2c8" returned: 0 in 0.822s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ec1a684d-5c2b-450a-bb64-d7dfe820365a tempest-VolumesActionsTest-1418965030 None] Lock "cinder-quobyte-0849f070-7d53-4c65-bf22-bb88940cc2c8" released by "delete_volume" :: held 1.701s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:27:56 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-ec1a684d-5c2b-450a-bb64-d7dfe820365a tempest-VolumesActionsTest-1418965030 None] Created reservations ['b0d819d8-5f0d-4f27-b633-0164420e0ebc', 'e1f8a8d5-d81a-4fc1-9f32-d34d8e78580e', '2d4fb531-b76c-4a2e-a110-173498075c4a', 'da335c2a-7782-4fca-81ff-2e0f2b96d995'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:27:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ec1a684d-5c2b-450a-bb64-d7dfe820365a tempest-VolumesActionsTest-1418965030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:27:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ec1a684d-5c2b-450a-bb64-d7dfe820365a tempest-VolumesActionsTest-1418965030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:27:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ec1a684d-5c2b-450a-bb64-d7dfe820365a tempest-VolumesActionsTest-1418965030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:27:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ec1a684d-5c2b-450a-bb64-d7dfe820365a tempest-VolumesActionsTest-1418965030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:27:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ec1a684d-5c2b-450a-bb64-d7dfe820365a tempest-VolumesActionsTest-1418965030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:27:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ec1a684d-5c2b-450a-bb64-d7dfe820365a tempest-VolumesActionsTest-1418965030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:56 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:27:56 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:57 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ec1a684d-5c2b-450a-bb64-d7dfe820365a tempest-VolumesActionsTest-1418965030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.722s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:57 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-ec1a684d-5c2b-450a-bb64-d7dfe820365a tempest-VolumesActionsTest-1418965030 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:27:57 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-ec1a684d-5c2b-450a-bb64-d7dfe820365a tempest-VolumesActionsTest-1418965030 None] Deleted volume successfully. Jul 06 15:27:57 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ec1a684d-5c2b-450a-bb64-d7dfe820365a tempest-VolumesActionsTest-1418965030 None] Lock "cinder-0849f070-7d53-4c65-bf22-bb88940cc2c8-delete_volume" released by "delete_volume" :: held 2.769s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:27:57 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:27:57 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Flow 'volume_create_manager' (1279d6f5-3252-4806-a0c0-5476372ee194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:27:57 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b967ce0-9334-46e2-ae4b-cb5553136013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:57 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b967ce0-9334-46e2-ae4b-cb5553136013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1409777883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd73f800-bdcc-48e3-992c-1bfdcd5e9601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1398d8b933fd4cf6a3afad2548eee617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:27:57Z,use_quota=True,user_id='aa21e3289b9445a9a83df85ca6309f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:57 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e78c38-4d5c-4aaa-934a-bf5a4e72a22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:57 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e78c38-4d5c-4aaa-934a-bf5a4e72a22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:57 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2da1bb93-812f-425e-befd-8bc2a26d897d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:57 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2da1bb93-812f-425e-befd-8bc2a26d897d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd73f800-bdcc-48e3-992c-1bfdcd5e9601', 'volume_name': 'volume-cd73f800-bdcc-48e3-992c-1bfdcd5e9601', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:57 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aeca4ec-8572-4b20-a7ce-5ad1cc8914f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:57 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aeca4ec-8572-4b20-a7ce-5ad1cc8914f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:57 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4d11e64-67e2-4eb6-b436-ce175471f75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:57 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Volume cd73f800-bdcc-48e3-992c-1bfdcd5e9601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd73f800-bdcc-48e3-992c-1bfdcd5e9601', 'volume_size': 1} Jul 06 15:27:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:27:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:27:57 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1409777883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd73f800-bdcc-48e3-992c-1bfdcd5e9601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1398d8b933fd4cf6a3afad2548eee617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:27:57Z,use_quota=True,user_id='aa21e3289b9445a9a83df85ca6309f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:27:57 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Creating volume cd73f800-bdcc-48e3-992c-1bfdcd5e9601 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:27:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:27:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:27:57 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:27:57 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:27:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:27:57 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:27:57 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:27:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd73f800-bdcc-48e3-992c-1bfdcd5e9601 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:57 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd73f800-bdcc-48e3-992c-1bfdcd5e9601 1073741824 Jul 06 15:27:57 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:58 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd73f800-bdcc-48e3-992c-1bfdcd5e9601 1073741824" returned: 0 in 1.040s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd73f800-bdcc-48e3-992c-1bfdcd5e9601 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:58 devstack sudo[90809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd73f800-bdcc-48e3-992c-1bfdcd5e9601 Jul 06 15:27:58 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:59 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd73f800-bdcc-48e3-992c-1bfdcd5e9601" returned: 0 in 0.718s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:59 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:27:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:27:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4d11e64-67e2-4eb6-b436-ce175471f75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd73f800-bdcc-48e3-992c-1bfdcd5e9601', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5342a3ce-2436-4c65-833c-4ced563786c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:59 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Volume volume-cd73f800-bdcc-48e3-992c-1bfdcd5e9601 (cd73f800-bdcc-48e3-992c-1bfdcd5e9601): created successfully Jul 06 15:27:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5342a3ce-2436-4c65-833c-4ced563786c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Flow 'volume_create_manager' (1279d6f5-3252-4806-a0c0-5476372ee194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:27:59 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-752b3461-e701-45a9-995b-1c529dfca25a tempest-VolumesActionsTest-1370696701 None] Created volume successfully. Jul 06 15:28:00 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-cb29699f-d5c0-471a-ad9d-637447653991 tempest-VolumesActionsTest-1418965030 None] Acquiring lock "cinder-cd73f800-bdcc-48e3-992c-1bfdcd5e9601-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:28:00 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-cb29699f-d5c0-471a-ad9d-637447653991 tempest-VolumesActionsTest-1418965030 None] Lock "cinder-cd73f800-bdcc-48e3-992c-1bfdcd5e9601-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:28:00 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-cb29699f-d5c0-471a-ad9d-637447653991 tempest-VolumesActionsTest-1418965030 None] Acquiring lock "cinder-quobyte-cd73f800-bdcc-48e3-992c-1bfdcd5e9601" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:28:01 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-cb29699f-d5c0-471a-ad9d-637447653991 tempest-VolumesActionsTest-1418965030 None] Lock "cinder-quobyte-cd73f800-bdcc-48e3-992c-1bfdcd5e9601" acquired by "delete_volume" :: waited 0.031s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:28:01 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f3d086-6f9f-4f97-9139-b8cd38f78f72]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:28:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cb29699f-d5c0-471a-ad9d-637447653991 tempest-VolumesActionsTest-1418965030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd73f800-bdcc-48e3-992c-1bfdcd5e9601 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:01 devstack sudo[90815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd73f800-bdcc-48e3-992c-1bfdcd5e9601 Jul 06 15:28:01 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:02 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cb29699f-d5c0-471a-ad9d-637447653991 tempest-VolumesActionsTest-1418965030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd73f800-bdcc-48e3-992c-1bfdcd5e9601" returned: 0 in 1.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cb29699f-d5c0-471a-ad9d-637447653991 tempest-VolumesActionsTest-1418965030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd73f800-bdcc-48e3-992c-1bfdcd5e9601 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:02 devstack sudo[90821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd73f800-bdcc-48e3-992c-1bfdcd5e9601 Jul 06 15:28:02 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:02 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:28:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Flow 'volume_create_manager' (9d066a88-484f-47d4-9caf-6f531cb40773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:28:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334276bb-8541-4ef1-a5ab-47e250d7abb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334276bb-8541-4ef1-a5ab-47e250d7abb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-732227350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c457ae1-17fe-49f5-ba43-deeeb54f9553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6492260e4ba44582b3aa4b9a2d698abb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:02Z,use_quota=True,user_id='cc6c104480c440298513aa7bfa1be0b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c43696b-5558-449c-800d-7582effc1797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c43696b-5558-449c-800d-7582effc1797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e360e58-c399-4689-b532-cad660dea1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e360e58-c399-4689-b532-cad660dea1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c457ae1-17fe-49f5-ba43-deeeb54f9553', 'volume_name': 'volume-0c457ae1-17fe-49f5-ba43-deeeb54f9553', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8aebe88-0eb4-46c0-82bf-788bd09fee88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8aebe88-0eb4-46c0-82bf-788bd09fee88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9fee88d-911a-404f-a063-5c76a03d7fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:02 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Volume 0c457ae1-17fe-49f5-ba43-deeeb54f9553: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c457ae1-17fe-49f5-ba43-deeeb54f9553', 'volume_size': 1} Jul 06 15:28:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:02 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-732227350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c457ae1-17fe-49f5-ba43-deeeb54f9553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6492260e4ba44582b3aa4b9a2d698abb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:02Z,use_quota=True,user_id='cc6c104480c440298513aa7bfa1be0b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:28:02 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Creating volume 0c457ae1-17fe-49f5-ba43-deeeb54f9553 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:28:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:02 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:28:02 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:28:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:02 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:28:02 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:28:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0c457ae1-17fe-49f5-ba43-deeeb54f9553 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:02 devstack sudo[90826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0c457ae1-17fe-49f5-ba43-deeeb54f9553 1073741824 Jul 06 15:28:02 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:03 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cb29699f-d5c0-471a-ad9d-637447653991 tempest-VolumesActionsTest-1418965030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd73f800-bdcc-48e3-992c-1bfdcd5e9601" returned: 0 in 0.982s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:03 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-cb29699f-d5c0-471a-ad9d-637447653991 tempest-VolumesActionsTest-1418965030 None] Lock "cinder-quobyte-cd73f800-bdcc-48e3-992c-1bfdcd5e9601" released by "delete_volume" :: held 2.055s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:28:03 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-cb29699f-d5c0-471a-ad9d-637447653991 tempest-VolumesActionsTest-1418965030 None] Created reservations ['d50e207a-ce7f-41ea-8aeb-650589bc1283', '4fb87263-8e83-4ab5-96d2-c83f03db6d78', 'b109ad0d-55e5-41ee-8a84-25a76d791593', 'bd261f09-0219-4f8c-9216-a59d384e6b8b'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:28:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-cb29699f-d5c0-471a-ad9d-637447653991 tempest-VolumesActionsTest-1418965030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-cb29699f-d5c0-471a-ad9d-637447653991 tempest-VolumesActionsTest-1418965030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:03 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-cb29699f-d5c0-471a-ad9d-637447653991 tempest-VolumesActionsTest-1418965030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:28:03 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-cb29699f-d5c0-471a-ad9d-637447653991 tempest-VolumesActionsTest-1418965030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:28:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-cb29699f-d5c0-471a-ad9d-637447653991 tempest-VolumesActionsTest-1418965030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cb29699f-d5c0-471a-ad9d-637447653991 tempest-VolumesActionsTest-1418965030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:03 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:28:03 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0c457ae1-17fe-49f5-ba43-deeeb54f9553 1073741824" returned: 0 in 1.323s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:03 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0c457ae1-17fe-49f5-ba43-deeeb54f9553 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:03 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0c457ae1-17fe-49f5-ba43-deeeb54f9553 Jul 06 15:28:03 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:04 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cb29699f-d5c0-471a-ad9d-637447653991 tempest-VolumesActionsTest-1418965030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.032s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:04 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-cb29699f-d5c0-471a-ad9d-637447653991 tempest-VolumesActionsTest-1418965030 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:28:04 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-cb29699f-d5c0-471a-ad9d-637447653991 tempest-VolumesActionsTest-1418965030 None] Deleted volume successfully. Jul 06 15:28:04 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-cb29699f-d5c0-471a-ad9d-637447653991 tempest-VolumesActionsTest-1418965030 None] Lock "cinder-cd73f800-bdcc-48e3-992c-1bfdcd5e9601-delete_volume" released by "delete_volume" :: held 3.525s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:28:04 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0c457ae1-17fe-49f5-ba43-deeeb54f9553" returned: 0 in 0.958s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:04 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] <== create_volume: return (2390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:28:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.394s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9fee88d-911a-404f-a063-5c76a03d7fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c457ae1-17fe-49f5-ba43-deeeb54f9553', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8c35b3-0606-46c5-b312-0eb4d1df0e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:04 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Volume volume-0c457ae1-17fe-49f5-ba43-deeeb54f9553 (0c457ae1-17fe-49f5-ba43-deeeb54f9553): created successfully Jul 06 15:28:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8c35b3-0606-46c5-b312-0eb4d1df0e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Flow 'volume_create_manager' (9d066a88-484f-47d4-9caf-6f531cb40773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:28:04 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-6bb22e61-3913-4245-bf8f-8e25df4acebc tempest-ServerActionsTestOtherA-2083244986 None] Created volume successfully. Jul 06 15:28:05 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:28:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Flow 'volume_create_manager' (1cd066f8-bcf8-42da-8ea0-507c0a7de26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:28:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a64fe88-c8ca-4afc-bcb0-3f0cb64670db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a64fe88-c8ca-4afc-bcb0-3f0cb64670db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2050847188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4455bb21-14f2-4324-8b38-dc0c2dab426d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1398d8b933fd4cf6a3afad2548eee617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:05Z,use_quota=True,user_id='aa21e3289b9445a9a83df85ca6309f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffcfc4c4-9d0b-415e-a02a-aef107cf1087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffcfc4c4-9d0b-415e-a02a-aef107cf1087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48cd072d-3a5e-4dd4-bbb2-0539d7798fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48cd072d-3a5e-4dd4-bbb2-0539d7798fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4455bb21-14f2-4324-8b38-dc0c2dab426d', 'volume_name': 'volume-4455bb21-14f2-4324-8b38-dc0c2dab426d', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d945ef01-58ab-4eb8-b71a-6c28a6aaf894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d945ef01-58ab-4eb8-b71a-6c28a6aaf894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16bbfb1-bf53-4cd9-9e28-5aacde4cf8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:05 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Volume 4455bb21-14f2-4324-8b38-dc0c2dab426d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4455bb21-14f2-4324-8b38-dc0c2dab426d', 'volume_size': 1} Jul 06 15:28:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:05 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2050847188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4455bb21-14f2-4324-8b38-dc0c2dab426d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1398d8b933fd4cf6a3afad2548eee617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:05Z,use_quota=True,user_id='aa21e3289b9445a9a83df85ca6309f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:28:05 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Creating volume 4455bb21-14f2-4324-8b38-dc0c2dab426d {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:28:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:05 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:28:05 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:28:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:05 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:28:05 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:28:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4455bb21-14f2-4324-8b38-dc0c2dab426d 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:05 devstack sudo[90841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4455bb21-14f2-4324-8b38-dc0c2dab426d 1073741824 Jul 06 15:28:05 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:06 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4455bb21-14f2-4324-8b38-dc0c2dab426d 1073741824" returned: 0 in 1.029s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4455bb21-14f2-4324-8b38-dc0c2dab426d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:06 devstack sudo[90850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4455bb21-14f2-4324-8b38-dc0c2dab426d Jul 06 15:28:06 devstack sudo[90850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:07 devstack sudo[90850]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4455bb21-14f2-4324-8b38-dc0c2dab426d" returned: 0 in 0.778s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:28:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16bbfb1-bf53-4cd9-9e28-5aacde4cf8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4455bb21-14f2-4324-8b38-dc0c2dab426d', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae963308-b36a-41ca-8225-76a970934449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:07 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Volume volume-4455bb21-14f2-4324-8b38-dc0c2dab426d (4455bb21-14f2-4324-8b38-dc0c2dab426d): created successfully Jul 06 15:28:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae963308-b36a-41ca-8225-76a970934449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Flow 'volume_create_manager' (1cd066f8-bcf8-42da-8ea0-507c0a7de26b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:28:07 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-4d921939-c400-4996-8fe1-909f9f2029ed tempest-VolumesActionsTest-1370696701 None] Created volume successfully. Jul 06 15:28:08 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-54bfd996-53a6-4561-b0ea-13d9cc265e3f tempest-VolumesActionsTest-1418965030 None] Acquiring lock "cinder-4455bb21-14f2-4324-8b38-dc0c2dab426d-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:28:08 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-54bfd996-53a6-4561-b0ea-13d9cc265e3f tempest-VolumesActionsTest-1418965030 None] Lock "cinder-4455bb21-14f2-4324-8b38-dc0c2dab426d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:28:08 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-54bfd996-53a6-4561-b0ea-13d9cc265e3f tempest-VolumesActionsTest-1418965030 None] Acquiring lock "cinder-quobyte-4455bb21-14f2-4324-8b38-dc0c2dab426d" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:28:08 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-54bfd996-53a6-4561-b0ea-13d9cc265e3f tempest-VolumesActionsTest-1418965030 None] Lock "cinder-quobyte-4455bb21-14f2-4324-8b38-dc0c2dab426d" acquired by "delete_volume" :: waited 0.022s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:28:08 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c902de-5da7-47e1-83e3-b53ae5112c52]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:28:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-54bfd996-53a6-4561-b0ea-13d9cc265e3f tempest-VolumesActionsTest-1418965030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4455bb21-14f2-4324-8b38-dc0c2dab426d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:08 devstack sudo[90856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4455bb21-14f2-4324-8b38-dc0c2dab426d Jul 06 15:28:08 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:09 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:28:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Flow 'volume_create_manager' (5477db74-3b12-4da0-b49f-daa0b3932b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:28:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c4daf88-0c39-41d2-8e3c-f9b0c02bfce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c4daf88-0c39-41d2-8e3c-f9b0c02bfce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1917081663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e519e3-f277-45de-8f9f-3359d210027c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5416b72c14d64b31bb6434f969d8205d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:09Z,use_quota=True,user_id='d1a65037c6ad4d0b8a5487b4a4f07287',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8e56e1-3e63-4886-97ae-5a60439e81c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8e56e1-3e63-4886-97ae-5a60439e81c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233774bc-6811-48bf-ba35-c89a23202532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233774bc-6811-48bf-ba35-c89a23202532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24e519e3-f277-45de-8f9f-3359d210027c', 'volume_name': 'volume-24e519e3-f277-45de-8f9f-3359d210027c', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58789757-f557-4230-ac94-9d54aaba002e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58789757-f557-4230-ac94-9d54aaba002e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7d8fc78-dc41-4d44-a5ff-48e23a798628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:09 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Volume 24e519e3-f277-45de-8f9f-3359d210027c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24e519e3-f277-45de-8f9f-3359d210027c', 'volume_size': 1} Jul 06 15:28:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1917081663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e519e3-f277-45de-8f9f-3359d210027c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5416b72c14d64b31bb6434f969d8205d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:09Z,use_quota=True,user_id='d1a65037c6ad4d0b8a5487b4a4f07287',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:28:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Creating volume 24e519e3-f277-45de-8f9f-3359d210027c {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:28:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:28:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:28:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:28:09 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:28:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:09 devstack sudo[90858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c 1073741824 Jul 06 15:28:09 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:09 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-54bfd996-53a6-4561-b0ea-13d9cc265e3f tempest-VolumesActionsTest-1418965030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4455bb21-14f2-4324-8b38-dc0c2dab426d" returned: 0 in 1.178s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-54bfd996-53a6-4561-b0ea-13d9cc265e3f tempest-VolumesActionsTest-1418965030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4455bb21-14f2-4324-8b38-dc0c2dab426d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:09 devstack sudo[90864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4455bb21-14f2-4324-8b38-dc0c2dab426d Jul 06 15:28:09 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:10 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c 1073741824" returned: 0 in 1.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:10 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-54bfd996-53a6-4561-b0ea-13d9cc265e3f tempest-VolumesActionsTest-1418965030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4455bb21-14f2-4324-8b38-dc0c2dab426d" returned: 0 in 0.840s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-54bfd996-53a6-4561-b0ea-13d9cc265e3f tempest-VolumesActionsTest-1418965030 None] Lock "cinder-quobyte-4455bb21-14f2-4324-8b38-dc0c2dab426d" released by "delete_volume" :: held 2.083s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:28:10 devstack sudo[90888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c Jul 06 15:28:10 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:10 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-54bfd996-53a6-4561-b0ea-13d9cc265e3f tempest-VolumesActionsTest-1418965030 None] Created reservations ['2cce777d-23e1-48c0-91b8-8b1be0dee2c4', 'a10e5b36-b4b5-43ef-b98c-59ccb2fda6e1', '5710fa9d-89e1-4cc5-a20c-683036e5926b', '2ac26c6f-060f-4e49-9dae-417d6c40ed6a'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:28:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-54bfd996-53a6-4561-b0ea-13d9cc265e3f tempest-VolumesActionsTest-1418965030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-54bfd996-53a6-4561-b0ea-13d9cc265e3f tempest-VolumesActionsTest-1418965030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:10 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-54bfd996-53a6-4561-b0ea-13d9cc265e3f tempest-VolumesActionsTest-1418965030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:28:10 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-54bfd996-53a6-4561-b0ea-13d9cc265e3f tempest-VolumesActionsTest-1418965030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:28:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-54bfd996-53a6-4561-b0ea-13d9cc265e3f tempest-VolumesActionsTest-1418965030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-54bfd996-53a6-4561-b0ea-13d9cc265e3f tempest-VolumesActionsTest-1418965030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:10 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:28:10 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:11 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c" returned: 0 in 0.734s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:28:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7d8fc78-dc41-4d44-a5ff-48e23a798628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24e519e3-f277-45de-8f9f-3359d210027c', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a091211-66a4-4547-af13-778a96c1dd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:11 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Volume volume-24e519e3-f277-45de-8f9f-3359d210027c (24e519e3-f277-45de-8f9f-3359d210027c): created successfully Jul 06 15:28:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a091211-66a4-4547-af13-778a96c1dd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Flow 'volume_create_manager' (5477db74-3b12-4da0-b49f-daa0b3932b80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:28:11 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-8454b776-3810-4488-bfe5-99c5b275ad14 req-65059526-f977-4240-8431-523d54250e8a tempest-VolumesSnapshotsTestJSON-2131257939 None] Created volume successfully. Jul 06 15:28:11 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-54bfd996-53a6-4561-b0ea-13d9cc265e3f tempest-VolumesActionsTest-1418965030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.711s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:11 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-54bfd996-53a6-4561-b0ea-13d9cc265e3f tempest-VolumesActionsTest-1418965030 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:28:11 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-54bfd996-53a6-4561-b0ea-13d9cc265e3f tempest-VolumesActionsTest-1418965030 None] Deleted volume successfully. Jul 06 15:28:11 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-54bfd996-53a6-4561-b0ea-13d9cc265e3f tempest-VolumesActionsTest-1418965030 None] Lock "cinder-4455bb21-14f2-4324-8b38-dc0c2dab426d-delete_volume" released by "delete_volume" :: held 3.164s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:28:12 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:28:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Flow 'volume_create_manager' (6f03bf84-1a5f-4a6e-86dd-4302de7ad423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:28:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c3ae8a-2512-43b4-a13f-416083e9c917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c3ae8a-2512-43b4-a13f-416083e9c917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1095824271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff39efbf-33cc-4269-8624-23c7675231db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1398d8b933fd4cf6a3afad2548eee617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:12Z,use_quota=True,user_id='aa21e3289b9445a9a83df85ca6309f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b3f5839-2f39-4bbf-9ffa-7ae55f5f974a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b3f5839-2f39-4bbf-9ffa-7ae55f5f974a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce192cf5-8aa2-4fc6-a27a-8f2a11aaeddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce192cf5-8aa2-4fc6-a27a-8f2a11aaeddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff39efbf-33cc-4269-8624-23c7675231db', 'volume_name': 'volume-ff39efbf-33cc-4269-8624-23c7675231db', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d70029-7d3f-491b-84f4-a91f31811eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d70029-7d3f-491b-84f4-a91f31811eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d4b7a9-6d08-4738-91cb-fac8abe76166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:12 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Volume ff39efbf-33cc-4269-8624-23c7675231db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff39efbf-33cc-4269-8624-23c7675231db', 'volume_size': 1} Jul 06 15:28:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1095824271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff39efbf-33cc-4269-8624-23c7675231db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1398d8b933fd4cf6a3afad2548eee617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:12Z,use_quota=True,user_id='aa21e3289b9445a9a83df85ca6309f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:28:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Creating volume ff39efbf-33cc-4269-8624-23c7675231db {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:28:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:28:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:28:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:28:12 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:28:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ff39efbf-33cc-4269-8624-23c7675231db 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:12 devstack sudo[90900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ff39efbf-33cc-4269-8624-23c7675231db 1073741824 Jul 06 15:28:12 devstack sudo[90900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-defadb87-c851-4c1d-86b9-7c81c027a513 req-04a7962f-6376-42df-a68d-651b2eb60242 tempest-VolumesSnapshotsTestJSON-2131257939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:13 devstack sudo[90900]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ff39efbf-33cc-4269-8624-23c7675231db 1073741824" returned: 0 in 1.025s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ff39efbf-33cc-4269-8624-23c7675231db {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:13 devstack sudo[90922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ff39efbf-33cc-4269-8624-23c7675231db Jul 06 15:28:13 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:14 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ff39efbf-33cc-4269-8624-23c7675231db" returned: 0 in 0.751s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] <== create_volume: return (1843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:28:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-defadb87-c851-4c1d-86b9-7c81c027a513 req-04a7962f-6376-42df-a68d-651b2eb60242 tempest-VolumesSnapshotsTestJSON-2131257939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.690s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [req-defadb87-c851-4c1d-86b9-7c81c027a513 req-04a7962f-6376-42df-a68d-651b2eb60242 tempest-VolumesSnapshotsTestJSON-2131257939 None] Creating offline snapshot 640865ce-d467-428c-a237-edd17e24bbd3 of volume 24e519e3-f277-45de-8f9f-3359d210027c {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:28:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d4b7a9-6d08-4738-91cb-fac8abe76166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff39efbf-33cc-4269-8624-23c7675231db', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c9dea24-8390-4783-9118-1cca5a09e2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:14 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[64210c05-384b-486c-a53d-d8c460e63852]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:28:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-defadb87-c851-4c1d-86b9-7c81c027a513 req-04a7962f-6376-42df-a68d-651b2eb60242 tempest-VolumesSnapshotsTestJSON-2131257939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:14 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Volume volume-ff39efbf-33cc-4269-8624-23c7675231db (ff39efbf-33cc-4269-8624-23c7675231db): created successfully Jul 06 15:28:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c9dea24-8390-4783-9118-1cca5a09e2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Flow 'volume_create_manager' (6f03bf84-1a5f-4a6e-86dd-4302de7ad423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:28:14 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-3ed1cc6e-a2be-4d94-badf-c9e081471501 tempest-VolumesActionsTest-1370696701 None] Created volume successfully. Jul 06 15:28:14 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c Jul 06 15:28:14 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:15 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-defadb87-c851-4c1d-86b9-7c81c027a513 req-04a7962f-6376-42df-a68d-651b2eb60242 tempest-VolumesSnapshotsTestJSON-2131257939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c" returned: 0 in 0.973s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-defadb87-c851-4c1d-86b9-7c81c027a513 req-04a7962f-6376-42df-a68d-651b2eb60242 tempest-VolumesSnapshotsTestJSON-2131257939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c.640865ce-d467-428c-a237-edd17e24bbd3 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:15 devstack sudo[90980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c.640865ce-d467-428c-a237-edd17e24bbd3 1G Jul 06 15:28:15 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:15 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4b4f9263-ff38-4e90-bafa-5eee347a0e9d tempest-VolumesActionsTest-1418965030 None] Acquiring lock "cinder-ff39efbf-33cc-4269-8624-23c7675231db-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:28:15 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4b4f9263-ff38-4e90-bafa-5eee347a0e9d tempest-VolumesActionsTest-1418965030 None] Lock "cinder-ff39efbf-33cc-4269-8624-23c7675231db-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:28:15 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4b4f9263-ff38-4e90-bafa-5eee347a0e9d tempest-VolumesActionsTest-1418965030 None] Acquiring lock "cinder-quobyte-ff39efbf-33cc-4269-8624-23c7675231db" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:28:15 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4b4f9263-ff38-4e90-bafa-5eee347a0e9d tempest-VolumesActionsTest-1418965030 None] Lock "cinder-quobyte-ff39efbf-33cc-4269-8624-23c7675231db" acquired by "delete_volume" :: waited 0.021s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:28:16 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cf3900-83b1-4537-b7cd-f3e6ddac3f87]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:28:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4b4f9263-ff38-4e90-bafa-5eee347a0e9d tempest-VolumesActionsTest-1418965030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ff39efbf-33cc-4269-8624-23c7675231db {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:16 devstack sudo[90987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ff39efbf-33cc-4269-8624-23c7675231db Jul 06 15:28:16 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:16 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-defadb87-c851-4c1d-86b9-7c81c027a513 req-04a7962f-6376-42df-a68d-651b2eb60242 tempest-VolumesSnapshotsTestJSON-2131257939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c.640865ce-d467-428c-a237-edd17e24bbd3 1G" returned: 0 in 1.057s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-defadb87-c851-4c1d-86b9-7c81c027a513 req-04a7962f-6376-42df-a68d-651b2eb60242 tempest-VolumesSnapshotsTestJSON-2131257939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24e519e3-f277-45de-8f9f-3359d210027c -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c.640865ce-d467-428c-a237-edd17e24bbd3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:16 devstack sudo[91007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24e519e3-f277-45de-8f9f-3359d210027c -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c.640865ce-d467-428c-a237-edd17e24bbd3 Jul 06 15:28:16 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:16 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4b4f9263-ff38-4e90-bafa-5eee347a0e9d tempest-VolumesActionsTest-1418965030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ff39efbf-33cc-4269-8624-23c7675231db" returned: 0 in 0.966s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4b4f9263-ff38-4e90-bafa-5eee347a0e9d tempest-VolumesActionsTest-1418965030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ff39efbf-33cc-4269-8624-23c7675231db {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:17 devstack sudo[91012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ff39efbf-33cc-4269-8624-23c7675231db Jul 06 15:28:17 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:17 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-defadb87-c851-4c1d-86b9-7c81c027a513 req-04a7962f-6376-42df-a68d-651b2eb60242 tempest-VolumesSnapshotsTestJSON-2131257939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24e519e3-f277-45de-8f9f-3359d210027c -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c.640865ce-d467-428c-a237-edd17e24bbd3" returned: 0 in 0.935s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:17 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [req-defadb87-c851-4c1d-86b9-7c81c027a513 req-04a7962f-6376-42df-a68d-651b2eb60242 tempest-VolumesSnapshotsTestJSON-2131257939 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c.640865ce-d467-428c-a237-edd17e24bbd3 is being set with open permissions: ugo+rw Jul 06 15:28:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-defadb87-c851-4c1d-86b9-7c81c027a513 req-04a7962f-6376-42df-a68d-651b2eb60242 tempest-VolumesSnapshotsTestJSON-2131257939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c.640865ce-d467-428c-a237-edd17e24bbd3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:17 devstack sudo[91037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c.640865ce-d467-428c-a237-edd17e24bbd3 Jul 06 15:28:17 devstack sudo[91037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:18 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4b4f9263-ff38-4e90-bafa-5eee347a0e9d tempest-VolumesActionsTest-1418965030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ff39efbf-33cc-4269-8624-23c7675231db" returned: 0 in 1.240s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:18 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4b4f9263-ff38-4e90-bafa-5eee347a0e9d tempest-VolumesActionsTest-1418965030 None] Lock "cinder-quobyte-ff39efbf-33cc-4269-8624-23c7675231db" released by "delete_volume" :: held 2.285s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:28:18 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-4b4f9263-ff38-4e90-bafa-5eee347a0e9d tempest-VolumesActionsTest-1418965030 None] Created reservations ['862b5dff-b129-450d-87af-e522c86e6a3f', '11da7ab6-8a10-4fad-996e-d4ff01f094b3', '79a0f8a9-f72e-4b0e-9b0f-89654e968bfe', '4805fa6b-db78-41af-a665-ad72288c95ff'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:28:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4b4f9263-ff38-4e90-bafa-5eee347a0e9d tempest-VolumesActionsTest-1418965030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4b4f9263-ff38-4e90-bafa-5eee347a0e9d tempest-VolumesActionsTest-1418965030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:18 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4b4f9263-ff38-4e90-bafa-5eee347a0e9d tempest-VolumesActionsTest-1418965030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:28:18 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4b4f9263-ff38-4e90-bafa-5eee347a0e9d tempest-VolumesActionsTest-1418965030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:28:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4b4f9263-ff38-4e90-bafa-5eee347a0e9d tempest-VolumesActionsTest-1418965030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4b4f9263-ff38-4e90-bafa-5eee347a0e9d tempest-VolumesActionsTest-1418965030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:18 devstack sudo[91048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:28:18 devstack sudo[91048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:18 devstack sudo[91037]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-defadb87-c851-4c1d-86b9-7c81c027a513 req-04a7962f-6376-42df-a68d-651b2eb60242 tempest-VolumesSnapshotsTestJSON-2131257939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c.640865ce-d467-428c-a237-edd17e24bbd3" returned: 0 in 1.399s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-defadb87-c851-4c1d-86b9-7c81c027a513 req-04a7962f-6376-42df-a68d-651b2eb60242 tempest-VolumesSnapshotsTestJSON-2131257939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:19 devstack sudo[91052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c.info Jul 06 15:28:19 devstack sudo[91052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:19 devstack sudo[91048]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4b4f9263-ff38-4e90-bafa-5eee347a0e9d tempest-VolumesActionsTest-1418965030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.220s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:19 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-4b4f9263-ff38-4e90-bafa-5eee347a0e9d tempest-VolumesActionsTest-1418965030 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:28:19 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-4b4f9263-ff38-4e90-bafa-5eee347a0e9d tempest-VolumesActionsTest-1418965030 None] Deleted volume successfully. Jul 06 15:28:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4b4f9263-ff38-4e90-bafa-5eee347a0e9d tempest-VolumesActionsTest-1418965030 None] Lock "cinder-ff39efbf-33cc-4269-8624-23c7675231db-delete_volume" released by "delete_volume" :: held 3.894s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:28:20 devstack sudo[91052]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-defadb87-c851-4c1d-86b9-7c81c027a513 req-04a7962f-6376-42df-a68d-651b2eb60242 tempest-VolumesSnapshotsTestJSON-2131257939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c.info" returned: 0 in 1.532s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:20 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [req-defadb87-c851-4c1d-86b9-7c81c027a513 req-04a7962f-6376-42df-a68d-651b2eb60242 tempest-VolumesSnapshotsTestJSON-2131257939 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c.info is being set with open permissions: ugo+rw Jul 06 15:28:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-defadb87-c851-4c1d-86b9-7c81c027a513 req-04a7962f-6376-42df-a68d-651b2eb60242 tempest-VolumesSnapshotsTestJSON-2131257939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:20 devstack sudo[91075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c.info Jul 06 15:28:20 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:20 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:28:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Flow 'volume_create_manager' (a02ea156-98a0-4017-af61-bdf0f572b0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:28:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81afec59-a15b-4e27-aad5-6f2818522515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81afec59-a15b-4e27-aad5-6f2818522515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1199879679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb67be8-1c80-4218-9692-670c0b2d095e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1398d8b933fd4cf6a3afad2548eee617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:20Z,use_quota=True,user_id='aa21e3289b9445a9a83df85ca6309f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a98c1373-2d31-492d-9b92-dd9d7cf0bb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a98c1373-2d31-492d-9b92-dd9d7cf0bb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d60dda-ac25-46ae-8898-b83f926e5be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d60dda-ac25-46ae-8898-b83f926e5be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdb67be8-1c80-4218-9692-670c0b2d095e', 'volume_name': 'volume-bdb67be8-1c80-4218-9692-670c0b2d095e', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cceebe-a4b0-43a4-a98a-7b9a2ede43a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cceebe-a4b0-43a4-a98a-7b9a2ede43a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c3fed5-bfde-488a-8151-8be1413d89d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:20 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Volume bdb67be8-1c80-4218-9692-670c0b2d095e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdb67be8-1c80-4218-9692-670c0b2d095e', 'volume_size': 1} Jul 06 15:28:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:21 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-defadb87-c851-4c1d-86b9-7c81c027a513 req-04a7962f-6376-42df-a68d-651b2eb60242 tempest-VolumesSnapshotsTestJSON-2131257939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c.info" returned: 0 in 1.155s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-defadb87-c851-4c1d-86b9-7c81c027a513 req-04a7962f-6376-42df-a68d-651b2eb60242 tempest-VolumesSnapshotsTestJSON-2131257939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.219s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.021s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1199879679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb67be8-1c80-4218-9692-670c0b2d095e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1398d8b933fd4cf6a3afad2548eee617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:20Z,use_quota=True,user_id='aa21e3289b9445a9a83df85ca6309f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:28:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Creating volume bdb67be8-1c80-4218-9692-670c0b2d095e {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:28:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:28:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:28:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:28:21 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:28:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bdb67be8-1c80-4218-9692-670c0b2d095e 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:21 devstack sudo[91081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bdb67be8-1c80-4218-9692-670c0b2d095e 1073741824 Jul 06 15:28:21 devstack sudo[91081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:21 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-defadb87-c851-4c1d-86b9-7c81c027a513 req-04a7962f-6376-42df-a68d-651b2eb60242 tempest-VolumesSnapshotsTestJSON-2131257939 None] Create snapshot completed successfully Jul 06 15:28:22 devstack cinder-volume[86148]: DEBUG cinder.coordination [req-b702bc07-9335-4959-a33f-8b1582816d8a req-c66d6505-55da-4e08-9d40-68e872f3d818 tempest-VolumesSnapshotsTestJSON-2131257939 None] Acquiring lock "cinder-640865ce-d467-428c-a237-edd17e24bbd3-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:28:22 devstack cinder-volume[86148]: DEBUG cinder.coordination [req-b702bc07-9335-4959-a33f-8b1582816d8a req-c66d6505-55da-4e08-9d40-68e872f3d818 tempest-VolumesSnapshotsTestJSON-2131257939 None] Lock "cinder-640865ce-d467-428c-a237-edd17e24bbd3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:28:22 devstack cinder-volume[86148]: DEBUG cinder.coordination [req-b702bc07-9335-4959-a33f-8b1582816d8a req-c66d6505-55da-4e08-9d40-68e872f3d818 tempest-VolumesSnapshotsTestJSON-2131257939 None] Acquiring lock "cinder-quobyte-24e519e3-f277-45de-8f9f-3359d210027c" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:28:22 devstack cinder-volume[86148]: DEBUG cinder.coordination [req-b702bc07-9335-4959-a33f-8b1582816d8a req-c66d6505-55da-4e08-9d40-68e872f3d818 tempest-VolumesSnapshotsTestJSON-2131257939 None] Lock "cinder-quobyte-24e519e3-f277-45de-8f9f-3359d210027c" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:28:22 devstack cinder-volume[86148]: DEBUG cinder.coordination [req-b702bc07-9335-4959-a33f-8b1582816d8a req-c66d6505-55da-4e08-9d40-68e872f3d818 tempest-VolumesSnapshotsTestJSON-2131257939 None] Acquiring lock "cinder-quobyte-640865ce-d467-428c-a237-edd17e24bbd3" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:28:22 devstack cinder-volume[86148]: DEBUG cinder.coordination [req-b702bc07-9335-4959-a33f-8b1582816d8a req-c66d6505-55da-4e08-9d40-68e872f3d818 tempest-VolumesSnapshotsTestJSON-2131257939 None] Lock "cinder-quobyte-640865ce-d467-428c-a237-edd17e24bbd3" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:28:22 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [req-b702bc07-9335-4959-a33f-8b1582816d8a req-c66d6505-55da-4e08-9d40-68e872f3d818 tempest-VolumesSnapshotsTestJSON-2131257939 None] Deleting offline snapshot 640865ce-d467-428c-a237-edd17e24bbd3 of volume 24e519e3-f277-45de-8f9f-3359d210027c {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:28:22 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [req-b702bc07-9335-4959-a33f-8b1582816d8a req-c66d6505-55da-4e08-9d40-68e872f3d818 tempest-VolumesSnapshotsTestJSON-2131257939 None] snapshot_file for this snap is: volume-24e519e3-f277-45de-8f9f-3359d210027c.640865ce-d467-428c-a237-edd17e24bbd3 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:28:22 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b30c59a-ed3f-4ad6-aa98-96a7fe86147e]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:28:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-b702bc07-9335-4959-a33f-8b1582816d8a req-c66d6505-55da-4e08-9d40-68e872f3d818 tempest-VolumesSnapshotsTestJSON-2131257939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c.640865ce-d467-428c-a237-edd17e24bbd3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:22 devstack sudo[91087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c.640865ce-d467-428c-a237-edd17e24bbd3 Jul 06 15:28:22 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:23 devstack sudo[91081]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bdb67be8-1c80-4218-9692-670c0b2d095e 1073741824" returned: 0 in 1.280s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bdb67be8-1c80-4218-9692-670c0b2d095e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:23 devstack sudo[91090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bdb67be8-1c80-4218-9692-670c0b2d095e Jul 06 15:28:23 devstack sudo[91090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:24 devstack sudo[91090]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bdb67be8-1c80-4218-9692-670c0b2d095e" returned: 0 in 0.924s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] <== create_volume: return (2283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:28:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.294s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c3fed5-bfde-488a-8151-8be1413d89d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdb67be8-1c80-4218-9692-670c0b2d095e', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d14a5cf-9f41-42bc-9672-50c5bf920fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:24 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Volume volume-bdb67be8-1c80-4218-9692-670c0b2d095e (bdb67be8-1c80-4218-9692-670c0b2d095e): created successfully Jul 06 15:28:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d14a5cf-9f41-42bc-9672-50c5bf920fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Flow 'volume_create_manager' (a02ea156-98a0-4017-af61-bdf0f572b0d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:28:24 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-cc29e608-95eb-4552-8589-8045b0299383 tempest-VolumesActionsTest-1370696701 None] Created volume successfully. Jul 06 15:28:24 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-b702bc07-9335-4959-a33f-8b1582816d8a req-c66d6505-55da-4e08-9d40-68e872f3d818 tempest-VolumesSnapshotsTestJSON-2131257939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c.640865ce-d467-428c-a237-edd17e24bbd3" returned: 0 in 1.903s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [req-b702bc07-9335-4959-a33f-8b1582816d8a req-c66d6505-55da-4e08-9d40-68e872f3d818 tempest-VolumesSnapshotsTestJSON-2131257939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24e519e3-f277-45de-8f9f-3359d210027c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:28:24 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[d608d008-b4d9-449c-b16d-9027d3130a8e]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:28:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-b702bc07-9335-4959-a33f-8b1582816d8a req-c66d6505-55da-4e08-9d40-68e872f3d818 tempest-VolumesSnapshotsTestJSON-2131257939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:24 devstack sudo[91096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c Jul 06 15:28:24 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:25 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-b702bc07-9335-4959-a33f-8b1582816d8a req-c66d6505-55da-4e08-9d40-68e872f3d818 tempest-VolumesSnapshotsTestJSON-2131257939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c" returned: 0 in 1.336s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-b702bc07-9335-4959-a33f-8b1582816d8a req-c66d6505-55da-4e08-9d40-68e872f3d818 tempest-VolumesSnapshotsTestJSON-2131257939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c.640865ce-d467-428c-a237-edd17e24bbd3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:26 devstack sudo[91102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c.640865ce-d467-428c-a237-edd17e24bbd3 Jul 06 15:28:26 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1e477192-7df9-4117-ad0d-4db974a945f9 tempest-VolumesActionsTest-1370696701 None] Acquiring lock "cinder-bdb67be8-1c80-4218-9692-670c0b2d095e-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:28:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1e477192-7df9-4117-ad0d-4db974a945f9 tempest-VolumesActionsTest-1370696701 None] Lock "cinder-bdb67be8-1c80-4218-9692-670c0b2d095e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:28:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1e477192-7df9-4117-ad0d-4db974a945f9 tempest-VolumesActionsTest-1370696701 None] Acquiring lock "cinder-quobyte-bdb67be8-1c80-4218-9692-670c0b2d095e" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:28:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1e477192-7df9-4117-ad0d-4db974a945f9 tempest-VolumesActionsTest-1370696701 None] Lock "cinder-quobyte-bdb67be8-1c80-4218-9692-670c0b2d095e" acquired by "delete_volume" :: waited 0.051s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:28:26 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[520fd46f-1112-4375-bccc-51d54c8e64cf]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:28:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1e477192-7df9-4117-ad0d-4db974a945f9 tempest-VolumesActionsTest-1370696701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bdb67be8-1c80-4218-9692-670c0b2d095e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:26 devstack sudo[91105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bdb67be8-1c80-4218-9692-670c0b2d095e Jul 06 15:28:26 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:26 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-b702bc07-9335-4959-a33f-8b1582816d8a req-c66d6505-55da-4e08-9d40-68e872f3d818 tempest-VolumesSnapshotsTestJSON-2131257939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c.640865ce-d467-428c-a237-edd17e24bbd3" returned: 0 in 0.882s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-b702bc07-9335-4959-a33f-8b1582816d8a req-c66d6505-55da-4e08-9d40-68e872f3d818 tempest-VolumesSnapshotsTestJSON-2131257939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c.640865ce-d467-428c-a237-edd17e24bbd3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:26 devstack sudo[91111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c.640865ce-d467-428c-a237-edd17e24bbd3 Jul 06 15:28:26 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:27 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-b702bc07-9335-4959-a33f-8b1582816d8a req-c66d6505-55da-4e08-9d40-68e872f3d818 tempest-VolumesSnapshotsTestJSON-2131257939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c.640865ce-d467-428c-a237-edd17e24bbd3" returned: 0 in 0.829s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:27 devstack cinder-volume[86148]: DEBUG cinder.coordination [req-b702bc07-9335-4959-a33f-8b1582816d8a req-c66d6505-55da-4e08-9d40-68e872f3d818 tempest-VolumesSnapshotsTestJSON-2131257939 None] Lock "cinder-quobyte-640865ce-d467-428c-a237-edd17e24bbd3" released by "_delete_snapshot" :: held 5.119s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:28:27 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1e477192-7df9-4117-ad0d-4db974a945f9 tempest-VolumesActionsTest-1370696701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bdb67be8-1c80-4218-9692-670c0b2d095e" returned: 0 in 1.195s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1e477192-7df9-4117-ad0d-4db974a945f9 tempest-VolumesActionsTest-1370696701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bdb67be8-1c80-4218-9692-670c0b2d095e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:27 devstack cinder-volume[86148]: DEBUG cinder.coordination [req-b702bc07-9335-4959-a33f-8b1582816d8a req-c66d6505-55da-4e08-9d40-68e872f3d818 tempest-VolumesSnapshotsTestJSON-2131257939 None] Lock "cinder-quobyte-24e519e3-f277-45de-8f9f-3359d210027c" released by "delete_snapshot" :: held 5.212s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:28:27 devstack sudo[91117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bdb67be8-1c80-4218-9692-670c0b2d095e Jul 06 15:28:27 devstack sudo[91117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:27 devstack cinder-volume[86148]: DEBUG cinder.quota [req-b702bc07-9335-4959-a33f-8b1582816d8a req-c66d6505-55da-4e08-9d40-68e872f3d818 tempest-VolumesSnapshotsTestJSON-2131257939 None] Created reservations ['baa1830e-2c65-40f2-b5b8-8a750facb7c6', '551f58ed-0ced-4bf5-ac19-fc9c50ff8bad', '14e676c3-851b-46b1-9a75-9293fa8d1838', 'd98428bc-b868-4c4d-96f1-daea56b6b023'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:28:28 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-b702bc07-9335-4959-a33f-8b1582816d8a req-c66d6505-55da-4e08-9d40-68e872f3d818 tempest-VolumesSnapshotsTestJSON-2131257939 None] Delete snapshot completed successfully. Jul 06 15:28:28 devstack cinder-volume[86148]: DEBUG cinder.coordination [req-b702bc07-9335-4959-a33f-8b1582816d8a req-c66d6505-55da-4e08-9d40-68e872f3d818 tempest-VolumesSnapshotsTestJSON-2131257939 None] Lock "cinder-640865ce-d467-428c-a237-edd17e24bbd3-delete_snapshot" released by "delete_snapshot" :: held 5.551s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:28:28 devstack cinder-volume[86148]: DEBUG cinder.coordination [req-490ae81b-4ff7-4584-af5a-bf932850798e req-8bf4ace4-5a8a-4386-ad66-2a226bcbd563 tempest-VolumesSnapshotsTestJSON-2131257939 None] Acquiring lock "cinder-24e519e3-f277-45de-8f9f-3359d210027c-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:28:28 devstack cinder-volume[86148]: DEBUG cinder.coordination [req-490ae81b-4ff7-4584-af5a-bf932850798e req-8bf4ace4-5a8a-4386-ad66-2a226bcbd563 tempest-VolumesSnapshotsTestJSON-2131257939 None] Lock "cinder-24e519e3-f277-45de-8f9f-3359d210027c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:28:28 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:UPDATE=110,cinder:SELECT=80,cinder:INSERT=22,cinder:DELETE=12 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:28:28 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=77,cinder:UPDATE=101,cinder:INSERT=27,cinder:DELETE=7 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:28:28 devstack cinder-volume[86148]: DEBUG cinder.coordination [req-490ae81b-4ff7-4584-af5a-bf932850798e req-8bf4ace4-5a8a-4386-ad66-2a226bcbd563 tempest-VolumesSnapshotsTestJSON-2131257939 None] Acquiring lock "cinder-quobyte-24e519e3-f277-45de-8f9f-3359d210027c" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:28:28 devstack cinder-volume[86148]: DEBUG cinder.coordination [req-490ae81b-4ff7-4584-af5a-bf932850798e req-8bf4ace4-5a8a-4386-ad66-2a226bcbd563 tempest-VolumesSnapshotsTestJSON-2131257939 None] Lock "cinder-quobyte-24e519e3-f277-45de-8f9f-3359d210027c" acquired by "delete_volume" :: waited 0.049s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:28:28 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[64cb3554-753a-434a-bcad-c6a3d1f923d4]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:28:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-490ae81b-4ff7-4584-af5a-bf932850798e req-8bf4ace4-5a8a-4386-ad66-2a226bcbd563 tempest-VolumesSnapshotsTestJSON-2131257939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:28 devstack sudo[91117]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1e477192-7df9-4117-ad0d-4db974a945f9 tempest-VolumesActionsTest-1370696701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bdb67be8-1c80-4218-9692-670c0b2d095e" returned: 0 in 0.933s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:28 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1e477192-7df9-4117-ad0d-4db974a945f9 tempest-VolumesActionsTest-1370696701 None] Lock "cinder-quobyte-bdb67be8-1c80-4218-9692-670c0b2d095e" released by "delete_volume" :: held 2.205s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:28:28 devstack sudo[91121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c Jul 06 15:28:28 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:28 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-1e477192-7df9-4117-ad0d-4db974a945f9 tempest-VolumesActionsTest-1370696701 None] Created reservations ['0cb2c8ba-683d-4f6c-86f8-57f904f01692', '364686ee-4338-44c7-8e9b-0c744d2fbb55', 'b9688f9a-4260-447e-bfb5-5d976458f776', 'af4258dd-b096-4647-ad45-89a67dea6075'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:28:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1e477192-7df9-4117-ad0d-4db974a945f9 tempest-VolumesActionsTest-1370696701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1e477192-7df9-4117-ad0d-4db974a945f9 tempest-VolumesActionsTest-1370696701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:28 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1e477192-7df9-4117-ad0d-4db974a945f9 tempest-VolumesActionsTest-1370696701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:28:28 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1e477192-7df9-4117-ad0d-4db974a945f9 tempest-VolumesActionsTest-1370696701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:28:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1e477192-7df9-4117-ad0d-4db974a945f9 tempest-VolumesActionsTest-1370696701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1e477192-7df9-4117-ad0d-4db974a945f9 tempest-VolumesActionsTest-1370696701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:29 devstack sudo[91123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:28:29 devstack sudo[91123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:29 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-490ae81b-4ff7-4584-af5a-bf932850798e req-8bf4ace4-5a8a-4386-ad66-2a226bcbd563 tempest-VolumesSnapshotsTestJSON-2131257939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c" returned: 0 in 0.908s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-490ae81b-4ff7-4584-af5a-bf932850798e req-8bf4ace4-5a8a-4386-ad66-2a226bcbd563 tempest-VolumesSnapshotsTestJSON-2131257939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:29 devstack sudo[91129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c Jul 06 15:28:29 devstack sudo[91129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:29 devstack sudo[91123]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1e477192-7df9-4117-ad0d-4db974a945f9 tempest-VolumesActionsTest-1370696701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.852s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:29 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-1e477192-7df9-4117-ad0d-4db974a945f9 tempest-VolumesActionsTest-1370696701 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:28:29 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-1e477192-7df9-4117-ad0d-4db974a945f9 tempest-VolumesActionsTest-1370696701 None] Deleted volume successfully. Jul 06 15:28:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1e477192-7df9-4117-ad0d-4db974a945f9 tempest-VolumesActionsTest-1370696701 None] Lock "cinder-bdb67be8-1c80-4218-9692-670c0b2d095e-delete_volume" released by "delete_volume" :: held 3.504s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:28:30 devstack sudo[91129]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-490ae81b-4ff7-4584-af5a-bf932850798e req-8bf4ace4-5a8a-4386-ad66-2a226bcbd563 tempest-VolumesSnapshotsTestJSON-2131257939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e519e3-f277-45de-8f9f-3359d210027c" returned: 0 in 0.943s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:30 devstack cinder-volume[86148]: DEBUG cinder.coordination [req-490ae81b-4ff7-4584-af5a-bf932850798e req-8bf4ace4-5a8a-4386-ad66-2a226bcbd563 tempest-VolumesSnapshotsTestJSON-2131257939 None] Lock "cinder-quobyte-24e519e3-f277-45de-8f9f-3359d210027c" released by "delete_volume" :: held 1.954s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:28:30 devstack cinder-volume[86148]: DEBUG cinder.quota [req-490ae81b-4ff7-4584-af5a-bf932850798e req-8bf4ace4-5a8a-4386-ad66-2a226bcbd563 tempest-VolumesSnapshotsTestJSON-2131257939 None] Created reservations ['59927ffc-63b0-4bd7-8b86-ec308dd25785', '354343ca-801e-4940-816f-f9b0e13bbd86', '25d0d9c4-6402-42b8-91a6-6cce47deaebd', '061f5b09-8528-4c33-a586-8138ea4c7d84'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:28:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-490ae81b-4ff7-4584-af5a-bf932850798e req-8bf4ace4-5a8a-4386-ad66-2a226bcbd563 tempest-VolumesSnapshotsTestJSON-2131257939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-490ae81b-4ff7-4584-af5a-bf932850798e req-8bf4ace4-5a8a-4386-ad66-2a226bcbd563 tempest-VolumesSnapshotsTestJSON-2131257939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [req-490ae81b-4ff7-4584-af5a-bf932850798e req-8bf4ace4-5a8a-4386-ad66-2a226bcbd563 tempest-VolumesSnapshotsTestJSON-2131257939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:28:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [req-490ae81b-4ff7-4584-af5a-bf932850798e req-8bf4ace4-5a8a-4386-ad66-2a226bcbd563 tempest-VolumesSnapshotsTestJSON-2131257939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:28:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-490ae81b-4ff7-4584-af5a-bf932850798e req-8bf4ace4-5a8a-4386-ad66-2a226bcbd563 tempest-VolumesSnapshotsTestJSON-2131257939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-490ae81b-4ff7-4584-af5a-bf932850798e req-8bf4ace4-5a8a-4386-ad66-2a226bcbd563 tempest-VolumesSnapshotsTestJSON-2131257939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:30 devstack sudo[91133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:28:30 devstack sudo[91133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:32 devstack sudo[91133]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-490ae81b-4ff7-4584-af5a-bf932850798e req-8bf4ace4-5a8a-4386-ad66-2a226bcbd563 tempest-VolumesSnapshotsTestJSON-2131257939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.546s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:32 devstack cinder-volume[86148]: DEBUG cinder.manager [req-490ae81b-4ff7-4584-af5a-bf932850798e req-8bf4ace4-5a8a-4386-ad66-2a226bcbd563 tempest-VolumesSnapshotsTestJSON-2131257939 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:28:32 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-490ae81b-4ff7-4584-af5a-bf932850798e req-8bf4ace4-5a8a-4386-ad66-2a226bcbd563 tempest-VolumesSnapshotsTestJSON-2131257939 None] Deleted volume successfully. Jul 06 15:28:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [req-490ae81b-4ff7-4584-af5a-bf932850798e req-8bf4ace4-5a8a-4386-ad66-2a226bcbd563 tempest-VolumesSnapshotsTestJSON-2131257939 None] Lock "cinder-24e519e3-f277-45de-8f9f-3359d210027c-delete_volume" released by "delete_volume" :: held 3.872s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:28:36 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:28:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Flow 'volume_create_manager' (70b82f4a-73bb-4762-be9f-75095d924456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:28:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c93fe46a-2526-49e6-bf0d-0654b924d507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c93fe46a-2526-49e6-bf0d-0654b924d507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1075592342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5763c9d5-0b9f-44a6-90e7-c240182c37cd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='144a0d55ac6246f6875a3bd355a5283e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:36Z,use_quota=True,user_id='7c0d0d7cc189431db46944adea1c6aa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc74e0c9-ed10-4b78-ab4b-0d34c2547231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc74e0c9-ed10-4b78-ab4b-0d34c2547231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7c17fb-2c84-4a03-a657-320c6d1adbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7c17fb-2c84-4a03-a657-320c6d1adbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5763c9d5-0b9f-44a6-90e7-c240182c37cd', 'volume_name': 'volume-5763c9d5-0b9f-44a6-90e7-c240182c37cd', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51899b2d-705f-4af3-b450-c0f8c41226b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51899b2d-705f-4af3-b450-c0f8c41226b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c105aca-bc14-4180-8293-7d86a8607047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:36 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Volume 5763c9d5-0b9f-44a6-90e7-c240182c37cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5763c9d5-0b9f-44a6-90e7-c240182c37cd', 'volume_size': 1} Jul 06 15:28:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1075592342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5763c9d5-0b9f-44a6-90e7-c240182c37cd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='144a0d55ac6246f6875a3bd355a5283e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:36Z,use_quota=True,user_id='7c0d0d7cc189431db46944adea1c6aa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:28:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Creating volume 5763c9d5-0b9f-44a6-90e7-c240182c37cd {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:28:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:28:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:28:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:28:36 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:28:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5763c9d5-0b9f-44a6-90e7-c240182c37cd 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:36 devstack sudo[91214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5763c9d5-0b9f-44a6-90e7-c240182c37cd 1073741824 Jul 06 15:28:36 devstack sudo[91214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:37 devstack sudo[91214]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5763c9d5-0b9f-44a6-90e7-c240182c37cd 1073741824" returned: 0 in 0.909s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5763c9d5-0b9f-44a6-90e7-c240182c37cd {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:37 devstack sudo[91223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5763c9d5-0b9f-44a6-90e7-c240182c37cd Jul 06 15:28:37 devstack sudo[91223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:38 devstack sudo[91223]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5763c9d5-0b9f-44a6-90e7-c240182c37cd" returned: 0 in 0.811s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:28:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c105aca-bc14-4180-8293-7d86a8607047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5763c9d5-0b9f-44a6-90e7-c240182c37cd', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b82e5e7-5037-4ff0-9e8e-be692a782874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:28:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:28:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:28:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:38 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Volume volume-5763c9d5-0b9f-44a6-90e7-c240182c37cd (5763c9d5-0b9f-44a6-90e7-c240182c37cd): created successfully Jul 06 15:28:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b82e5e7-5037-4ff0-9e8e-be692a782874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:38 devstack sudo[91227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:28:38 devstack sudo[91227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Flow 'volume_create_manager' (70b82f4a-73bb-4762-be9f-75095d924456) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:28:38 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-96463fb8-4ca8-4969-8cd4-473cdce7dd87 tempest-VolumesTestJSON-1597894362 None] Created volume successfully. Jul 06 15:28:39 devstack sudo[91227]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.851s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:28:39 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager._thread_info {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:28:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread count: 8 {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:28:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread info: [<_MainThread(MainThread, started 124857273856128)>, , , , , , , ] {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:28:40 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:28:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Flow 'volume_create_manager' (232e51dc-df6d-4f57-a5e2-8ef3714bbbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:28:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4de63ee-be4a-4486-af6a-223ea2d2b9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4de63ee-be4a-4486-af6a-223ea2d2b9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-834835300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3cb4947-dc3f-4f53-b27d-912545c8f08e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='144a0d55ac6246f6875a3bd355a5283e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:40Z,use_quota=True,user_id='7c0d0d7cc189431db46944adea1c6aa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dffc7f86-53dd-43ed-8c41-5b5a1f9dd89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dffc7f86-53dd-43ed-8c41-5b5a1f9dd89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8393ce7d-250a-428f-b653-7fcd2e3d31bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8393ce7d-250a-428f-b653-7fcd2e3d31bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3cb4947-dc3f-4f53-b27d-912545c8f08e', 'volume_name': 'volume-d3cb4947-dc3f-4f53-b27d-912545c8f08e', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e987a0-6052-4f19-9ee6-f913e1bc12d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e987a0-6052-4f19-9ee6-f913e1bc12d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821ea57c-b7df-4c8d-89da-d666fc1283ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:40 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Volume d3cb4947-dc3f-4f53-b27d-912545c8f08e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3cb4947-dc3f-4f53-b27d-912545c8f08e', 'volume_size': 1} Jul 06 15:28:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-834835300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3cb4947-dc3f-4f53-b27d-912545c8f08e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='144a0d55ac6246f6875a3bd355a5283e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:40Z,use_quota=True,user_id='7c0d0d7cc189431db46944adea1c6aa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:28:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Creating volume d3cb4947-dc3f-4f53-b27d-912545c8f08e {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:28:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:28:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:28:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:28:40 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:28:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3cb4947-dc3f-4f53-b27d-912545c8f08e 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:40 devstack sudo[91231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3cb4947-dc3f-4f53-b27d-912545c8f08e 1073741824 Jul 06 15:28:40 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:41 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3cb4947-dc3f-4f53-b27d-912545c8f08e 1073741824" returned: 0 in 0.940s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3cb4947-dc3f-4f53-b27d-912545c8f08e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:41 devstack sudo[91236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3cb4947-dc3f-4f53-b27d-912545c8f08e Jul 06 15:28:41 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:42 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3cb4947-dc3f-4f53-b27d-912545c8f08e" returned: 0 in 0.704s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:42 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:28:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821ea57c-b7df-4c8d-89da-d666fc1283ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3cb4947-dc3f-4f53-b27d-912545c8f08e', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175355d8-b536-4717-9498-ab01865f0bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:42 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Volume volume-d3cb4947-dc3f-4f53-b27d-912545c8f08e (d3cb4947-dc3f-4f53-b27d-912545c8f08e): created successfully Jul 06 15:28:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175355d8-b536-4717-9498-ab01865f0bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Flow 'volume_create_manager' (232e51dc-df6d-4f57-a5e2-8ef3714bbbec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:28:42 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-201a3c22-84e4-4f04-98c0-3ffd7afe0331 tempest-VolumesTestJSON-1597894362 None] Created volume successfully. Jul 06 15:28:42 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:28:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Flow 'volume_create_manager' (d5b34551-e950-4f6a-b515-934099816829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:28:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (931df862-7f46-4293-9811-9c2423bbaf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (931df862-7f46-4293-9811-9c2423bbaf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-584603356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61dd0380-0e1c-4734-a285-58618066b4a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7517620e6c0445c596e212b54fe362b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:43Z,use_quota=True,user_id='109b1ba5ab5348b1b153d833251cb0e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c0a305c-12e1-4e28-98ad-776e24ce609d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c0a305c-12e1-4e28-98ad-776e24ce609d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f589da9-2d40-4dae-8f07-5a5a414e3792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f589da9-2d40-4dae-8f07-5a5a414e3792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61dd0380-0e1c-4734-a285-58618066b4a3', 'volume_name': 'volume-61dd0380-0e1c-4734-a285-58618066b4a3', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a54a2b5-4519-4872-9495-a976ac524cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a54a2b5-4519-4872-9495-a976ac524cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf71231-1e0a-487a-b4e6-f411b5a8208e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:43 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Volume 61dd0380-0e1c-4734-a285-58618066b4a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61dd0380-0e1c-4734-a285-58618066b4a3', 'volume_size': 1} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-584603356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61dd0380-0e1c-4734-a285-58618066b4a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7517620e6c0445c596e212b54fe362b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:43Z,use_quota=True,user_id='109b1ba5ab5348b1b153d833251cb0e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Creating volume 61dd0380-0e1c-4734-a285-58618066b4a3 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:28:43 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:43 devstack sudo[91246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3 1073741824 Jul 06 15:28:43 devstack sudo[91246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Flow 'volume_create_manager' (630937fa-8f16-4310-8698-86a64907e149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d5b6ac-ef7d-499b-9e01-2eb9943b585a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d5b6ac-ef7d-499b-9e01-2eb9943b585a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-904102825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eae0954-68cf-4529-8ee5-8ab4a0761de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5abdd3edecc34be1b9e0eec22e216751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:43Z,use_quota=True,user_id='c73e587730e94979a0ab467fe16d3249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1f9fa70-5a1f-481a-88ba-2af4ceae5007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1f9fa70-5a1f-481a-88ba-2af4ceae5007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b0c4c78-4224-440e-b890-eecbeba39518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b0c4c78-4224-440e-b890-eecbeba39518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eae0954-68cf-4529-8ee5-8ab4a0761de5', 'volume_name': 'volume-0eae0954-68cf-4529-8ee5-8ab4a0761de5', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ccba5c-9324-4c19-922d-a2e7c8344fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ccba5c-9324-4c19-922d-a2e7c8344fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b3c9e2e-e3b0-4a55-8c74-e633c61b7685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:43 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Volume 0eae0954-68cf-4529-8ee5-8ab4a0761de5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eae0954-68cf-4529-8ee5-8ab4a0761de5', 'volume_size': 1} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Flow 'volume_create_manager' (ff726d45-9676-4f80-a161-58df04451e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef035382-90f3-4228-9d0c-54d1124f12ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef035382-90f3-4228-9d0c-54d1124f12ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-309038339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928545b3-f57e-47e9-bde3-4312e53d1908,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='144a0d55ac6246f6875a3bd355a5283e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:43Z,use_quota=True,user_id='7c0d0d7cc189431db46944adea1c6aa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05d4873-321e-45ca-b2dd-df32ee138366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05d4873-321e-45ca-b2dd-df32ee138366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bb0d0dc-cc55-4c7c-9d3c-edb661a21291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bb0d0dc-cc55-4c7c-9d3c-edb661a21291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '928545b3-f57e-47e9-bde3-4312e53d1908', 'volume_name': 'volume-928545b3-f57e-47e9-bde3-4312e53d1908', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2480bae-0be0-4f06-9c4e-e7eb1721eb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2480bae-0be0-4f06-9c4e-e7eb1721eb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c7ecb1-6c40-4824-924a-bc637db81fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:43 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Volume 928545b3-f57e-47e9-bde3-4312e53d1908: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-928545b3-f57e-47e9-bde3-4312e53d1908', 'volume_size': 1} Jul 06 15:28:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:44 devstack sudo[91246]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3 1073741824" returned: 0 in 0.969s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:44 devstack sudo[91252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3 Jul 06 15:28:44 devstack sudo[91252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:44 devstack sudo[91252]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3" returned: 0 in 0.656s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:28:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.402s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-904102825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eae0954-68cf-4529-8ee5-8ab4a0761de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5abdd3edecc34be1b9e0eec22e216751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:43Z,use_quota=True,user_id='c73e587730e94979a0ab467fe16d3249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:28:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Creating volume 0eae0954-68cf-4529-8ee5-8ab4a0761de5 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:28:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:28:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:28:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:28:44 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:28:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0eae0954-68cf-4529-8ee5-8ab4a0761de5 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:44 devstack sudo[91255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0eae0954-68cf-4529-8ee5-8ab4a0761de5 1073741824 Jul 06 15:28:44 devstack sudo[91255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf71231-1e0a-487a-b4e6-f411b5a8208e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61dd0380-0e1c-4734-a285-58618066b4a3', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98832c7b-7f4c-42d0-a9dd-8abe91e829de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:44 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Volume volume-61dd0380-0e1c-4734-a285-58618066b4a3 (61dd0380-0e1c-4734-a285-58618066b4a3): created successfully Jul 06 15:28:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98832c7b-7f4c-42d0-a9dd-8abe91e829de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Flow 'volume_create_manager' (d5b34551-e950-4f6a-b515-934099816829) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:28:44 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-213e0bf5-9f81-4120-9759-5031d2ed2da5 tempest-VolumesDeleteCascade-817725185 None] Created volume successfully. Jul 06 15:28:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-462b4726-6c49-4424-b71e-4edaac33aa54 tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:45 devstack sudo[91255]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0eae0954-68cf-4529-8ee5-8ab4a0761de5 1073741824" returned: 0 in 0.826s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0eae0954-68cf-4529-8ee5-8ab4a0761de5 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:45 devstack sudo[91261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0eae0954-68cf-4529-8ee5-8ab4a0761de5 Jul 06 15:28:45 devstack sudo[91261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:46 devstack sudo[91261]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0eae0954-68cf-4529-8ee5-8ab4a0761de5" returned: 0 in 0.700s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:28:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.689s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-309038339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928545b3-f57e-47e9-bde3-4312e53d1908,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='144a0d55ac6246f6875a3bd355a5283e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:28:43Z,use_quota=True,user_id='7c0d0d7cc189431db46944adea1c6aa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:28:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Creating volume 928545b3-f57e-47e9-bde3-4312e53d1908 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:28:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:28:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:28:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:28:46 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:28:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-928545b3-f57e-47e9-bde3-4312e53d1908 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b3c9e2e-e3b0-4a55-8c74-e633c61b7685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eae0954-68cf-4529-8ee5-8ab4a0761de5', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20cdf4f5-0fea-45ce-bea5-6bf864288880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:46 devstack sudo[91267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-928545b3-f57e-47e9-bde3-4312e53d1908 1073741824 Jul 06 15:28:46 devstack sudo[91267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:46 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Volume volume-0eae0954-68cf-4529-8ee5-8ab4a0761de5 (0eae0954-68cf-4529-8ee5-8ab4a0761de5): created successfully Jul 06 15:28:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20cdf4f5-0fea-45ce-bea5-6bf864288880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Flow 'volume_create_manager' (630937fa-8f16-4310-8698-86a64907e149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:28:46 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-7eb872a6-64c3-4590-9216-112f56e302fa tempest-AttachVolumeTestJSON-1381247220 None] Created volume successfully. Jul 06 15:28:47 devstack sudo[91267]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-928545b3-f57e-47e9-bde3-4312e53d1908 1073741824" returned: 0 in 0.903s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-928545b3-f57e-47e9-bde3-4312e53d1908 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:47 devstack sudo[91281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-928545b3-f57e-47e9-bde3-4312e53d1908 Jul 06 15:28:47 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:47 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-928545b3-f57e-47e9-bde3-4312e53d1908" returned: 0 in 0.684s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:47 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:28:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-462b4726-6c49-4424-b71e-4edaac33aa54 tempest-VolumesDeleteCascade-817725185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.707s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:47 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c7ecb1-6c40-4824-924a-bc637db81fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-928545b3-f57e-47e9-bde3-4312e53d1908', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:47 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f29ea4-0c14-4d00-a9ed-108779e0e6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:28:47 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-462b4726-6c49-4424-b71e-4edaac33aa54 tempest-VolumesDeleteCascade-817725185 None] Creating offline snapshot 5917ca7a-387c-41fb-9e13-a33b74b21b3e of volume 61dd0380-0e1c-4734-a285-58618066b4a3 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:28:48 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Volume volume-928545b3-f57e-47e9-bde3-4312e53d1908 (928545b3-f57e-47e9-bde3-4312e53d1908): created successfully Jul 06 15:28:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f29ea4-0c14-4d00-a9ed-108779e0e6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:28:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Flow 'volume_create_manager' (ff726d45-9676-4f80-a161-58df04451e4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:28:48 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2942c2-d9f0-4ea5-aa5f-041f57babf60]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:28:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-462b4726-6c49-4424-b71e-4edaac33aa54 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:48 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-75ad53de-bc9b-4b0e-a894-5d4494327225 tempest-VolumesTestJSON-1597894362 None] Created volume successfully. Jul 06 15:28:48 devstack sudo[91303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3 Jul 06 15:28:48 devstack sudo[91303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:48 devstack sudo[91303]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-462b4726-6c49-4424-b71e-4edaac33aa54 tempest-VolumesDeleteCascade-817725185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3" returned: 0 in 0.775s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-462b4726-6c49-4424-b71e-4edaac33aa54 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:48 devstack sudo[91309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e 1G Jul 06 15:28:48 devstack sudo[91309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:49 devstack sudo[91309]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-462b4726-6c49-4424-b71e-4edaac33aa54 tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e 1G" returned: 0 in 1.002s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-462b4726-6c49-4424-b71e-4edaac33aa54 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61dd0380-0e1c-4734-a285-58618066b4a3 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:49 devstack sudo[91324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61dd0380-0e1c-4734-a285-58618066b4a3 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e Jul 06 15:28:49 devstack sudo[91324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-d70b289d-7fdf-40e6-be2d-5756147eb4a2 req-b2d42439-9515-4247-86a5-5d99278079fd tempest-ServerActionsTestOtherA-2083244986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-e4ae05f3-78fa-4b2d-91bd-cfef1cdaa03e req-aa8476a4-3612-45c4-be40-014388b7a1d0 tempest-AttachVolumeTestJSON-1381247220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:50 devstack sudo[91324]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-462b4726-6c49-4424-b71e-4edaac33aa54 tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61dd0380-0e1c-4734-a285-58618066b4a3 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e" returned: 0 in 0.753s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:50 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-462b4726-6c49-4424-b71e-4edaac33aa54 tempest-VolumesDeleteCascade-817725185 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e is being set with open permissions: ugo+rw Jul 06 15:28:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-462b4726-6c49-4424-b71e-4edaac33aa54 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:50 devstack sudo[91338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e Jul 06 15:28:50 devstack sudo[91338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:51 devstack sudo[91338]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-462b4726-6c49-4424-b71e-4edaac33aa54 tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e" returned: 0 in 0.634s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-462b4726-6c49-4424-b71e-4edaac33aa54 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:51 devstack sudo[91341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.info Jul 06 15:28:51 devstack sudo[91341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:51 devstack sudo[91341]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-462b4726-6c49-4424-b71e-4edaac33aa54 tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.info" returned: 0 in 0.635s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:51 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-462b4726-6c49-4424-b71e-4edaac33aa54 tempest-VolumesDeleteCascade-817725185 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.info is being set with open permissions: ugo+rw Jul 06 15:28:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-462b4726-6c49-4424-b71e-4edaac33aa54 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:51 devstack sudo[91350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.info Jul 06 15:28:51 devstack sudo[91350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:52 devstack sudo[91350]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-462b4726-6c49-4424-b71e-4edaac33aa54 tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.info" returned: 0 in 0.621s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-462b4726-6c49-4424-b71e-4edaac33aa54 tempest-VolumesDeleteCascade-817725185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.535s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-d70b289d-7fdf-40e6-be2d-5756147eb4a2 req-b2d42439-9515-4247-86a5-5d99278079fd tempest-ServerActionsTestOtherA-2083244986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.581s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:52 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa20a73-d595-4c11-b4d3-0c33b57bce14]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:28:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-d70b289d-7fdf-40e6-be2d-5756147eb4a2 req-b2d42439-9515-4247-86a5-5d99278079fd tempest-ServerActionsTestOtherA-2083244986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0c457ae1-17fe-49f5-ba43-deeeb54f9553 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:52 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-462b4726-6c49-4424-b71e-4edaac33aa54 tempest-VolumesDeleteCascade-817725185 None] Create snapshot completed successfully Jul 06 15:28:52 devstack sudo[91353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0c457ae1-17fe-49f5-ba43-deeeb54f9553 Jul 06 15:28:52 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:53 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-d70b289d-7fdf-40e6-be2d-5756147eb4a2 req-b2d42439-9515-4247-86a5-5d99278079fd tempest-ServerActionsTestOtherA-2083244986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0c457ae1-17fe-49f5-ba43-deeeb54f9553" returned: 0 in 0.791s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-d70b289d-7fdf-40e6-be2d-5756147eb4a2 req-b2d42439-9515-4247-86a5-5d99278079fd tempest-ServerActionsTestOtherA-2083244986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.811s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-e4ae05f3-78fa-4b2d-91bd-cfef1cdaa03e req-aa8476a4-3612-45c4-be40-014388b7a1d0 tempest-AttachVolumeTestJSON-1381247220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.888s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:53 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed95ff7-9401-4e93-ae62-4bae977fd670]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:28:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-e4ae05f3-78fa-4b2d-91bd-cfef1cdaa03e req-aa8476a4-3612-45c4-be40-014388b7a1d0 tempest-AttachVolumeTestJSON-1381247220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0eae0954-68cf-4529-8ee5-8ab4a0761de5 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-d70b289d-7fdf-40e6-be2d-5756147eb4a2 req-b2d42439-9515-4247-86a5-5d99278079fd tempest-ServerActionsTestOtherA-2083244986 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce', 'name': 'volume-0c457ae1-17fe-49f5-ba43-deeeb54f9553', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a197c1d-3c8a-47d5-aa79-a631f5a61684', 'enforce_multipath': True} {{(pid=86148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:28:53 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-d70b289d-7fdf-40e6-be2d-5756147eb4a2 req-b2d42439-9515-4247-86a5-5d99278079fd tempest-ServerActionsTestOtherA-2083244986 None] attachment_update completed successfully. Jul 06 15:28:53 devstack sudo[91358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0eae0954-68cf-4529-8ee5-8ab4a0761de5 Jul 06 15:28:53 devstack sudo[91358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:54 devstack sudo[91358]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-e4ae05f3-78fa-4b2d-91bd-cfef1cdaa03e req-aa8476a4-3612-45c4-be40-014388b7a1d0 tempest-AttachVolumeTestJSON-1381247220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0eae0954-68cf-4529-8ee5-8ab4a0761de5" returned: 0 in 0.794s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-e4ae05f3-78fa-4b2d-91bd-cfef1cdaa03e req-aa8476a4-3612-45c4-be40-014388b7a1d0 tempest-AttachVolumeTestJSON-1381247220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.814s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-e4ae05f3-78fa-4b2d-91bd-cfef1cdaa03e req-aa8476a4-3612-45c4-be40-014388b7a1d0 tempest-AttachVolumeTestJSON-1381247220 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce', 'name': 'volume-0eae0954-68cf-4529-8ee5-8ab4a0761de5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1cc0022-4b1c-466b-84c0-ac67ea0dba43', 'enforce_multipath': True} {{(pid=86148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:28:54 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-e4ae05f3-78fa-4b2d-91bd-cfef1cdaa03e req-aa8476a4-3612-45c4-be40-014388b7a1d0 tempest-AttachVolumeTestJSON-1381247220 None] attachment_update completed successfully. Jul 06 15:28:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8eddba33-6286-4d5e-8ec5-8acf8bfaf49e tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8eddba33-6286-4d5e-8ec5-8acf8bfaf49e tempest-VolumesDeleteCascade-817725185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-8eddba33-6286-4d5e-8ec5-8acf8bfaf49e tempest-VolumesDeleteCascade-817725185 None] Creating offline snapshot 6fc87e4c-0ce1-4810-9956-21a7f956f88c of volume 61dd0380-0e1c-4734-a285-58618066b4a3 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:28:54 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bdac00-2a83-41b5-9e31-fbc55cc4feb1]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:28:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8eddba33-6286-4d5e-8ec5-8acf8bfaf49e tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-231b2ff1-70f3-4f2a-8561-ee331ff0e71a tempest-VolumesTestJSON-1597894362 None] Acquiring lock "cinder-928545b3-f57e-47e9-bde3-4312e53d1908-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:28:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-231b2ff1-70f3-4f2a-8561-ee331ff0e71a tempest-VolumesTestJSON-1597894362 None] Lock "cinder-928545b3-f57e-47e9-bde3-4312e53d1908-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:28:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-231b2ff1-70f3-4f2a-8561-ee331ff0e71a tempest-VolumesTestJSON-1597894362 None] Acquiring lock "cinder-quobyte-928545b3-f57e-47e9-bde3-4312e53d1908" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:28:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-231b2ff1-70f3-4f2a-8561-ee331ff0e71a tempest-VolumesTestJSON-1597894362 None] Lock "cinder-quobyte-928545b3-f57e-47e9-bde3-4312e53d1908" acquired by "delete_volume" :: waited 0.013s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:28:54 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[5374f363-302d-48dd-89c1-495c0e085e61]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:28:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-231b2ff1-70f3-4f2a-8561-ee331ff0e71a tempest-VolumesTestJSON-1597894362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-928545b3-f57e-47e9-bde3-4312e53d1908 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:54 devstack sudo[91430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e Jul 06 15:28:54 devstack sudo[91430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:54 devstack sudo[91431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-928545b3-f57e-47e9-bde3-4312e53d1908 Jul 06 15:28:54 devstack sudo[91431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:55 devstack sudo[91430]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8eddba33-6286-4d5e-8ec5-8acf8bfaf49e tempest-VolumesDeleteCascade-817725185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e" returned: 0 in 0.929s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:55 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-8eddba33-6286-4d5e-8ec5-8acf8bfaf49e tempest-VolumesDeleteCascade-817725185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61dd0380-0e1c-4734-a285-58618066b4a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:28:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8eddba33-6286-4d5e-8ec5-8acf8bfaf49e tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.6fc87e4c-0ce1-4810-9956-21a7f956f88c 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:55 devstack sudo[91431]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-231b2ff1-70f3-4f2a-8561-ee331ff0e71a tempest-VolumesTestJSON-1597894362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-928545b3-f57e-47e9-bde3-4312e53d1908" returned: 0 in 0.833s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-231b2ff1-70f3-4f2a-8561-ee331ff0e71a tempest-VolumesTestJSON-1597894362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-928545b3-f57e-47e9-bde3-4312e53d1908 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:55 devstack sudo[91758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.6fc87e4c-0ce1-4810-9956-21a7f956f88c 1G Jul 06 15:28:55 devstack sudo[91758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:55 devstack sudo[91759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-928545b3-f57e-47e9-bde3-4312e53d1908 Jul 06 15:28:55 devstack sudo[91759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:56 devstack sudo[91759]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-231b2ff1-70f3-4f2a-8561-ee331ff0e71a tempest-VolumesTestJSON-1597894362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-928545b3-f57e-47e9-bde3-4312e53d1908" returned: 0 in 0.700s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-231b2ff1-70f3-4f2a-8561-ee331ff0e71a tempest-VolumesTestJSON-1597894362 None] Lock "cinder-quobyte-928545b3-f57e-47e9-bde3-4312e53d1908" released by "delete_volume" :: held 1.572s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:28:56 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-231b2ff1-70f3-4f2a-8561-ee331ff0e71a tempest-VolumesTestJSON-1597894362 None] Created reservations ['40ea4cdf-009e-4d3c-951d-467936726ab2', 'a95d1fdb-0451-49df-9f79-abac037e1b9e', '85795b94-d9b9-408c-aa1c-ba4288e76d92', '1ba9bece-caf2-463b-af02-f12ae4aa22f5'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:28:56 devstack sudo[91758]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8eddba33-6286-4d5e-8ec5-8acf8bfaf49e tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.6fc87e4c-0ce1-4810-9956-21a7f956f88c 1G" returned: 0 in 0.843s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8eddba33-6286-4d5e-8ec5-8acf8bfaf49e tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.6fc87e4c-0ce1-4810-9956-21a7f956f88c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-231b2ff1-70f3-4f2a-8561-ee331ff0e71a tempest-VolumesTestJSON-1597894362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-231b2ff1-70f3-4f2a-8561-ee331ff0e71a tempest-VolumesTestJSON-1597894362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-231b2ff1-70f3-4f2a-8561-ee331ff0e71a tempest-VolumesTestJSON-1597894362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:28:56 devstack sudo[91766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.6fc87e4c-0ce1-4810-9956-21a7f956f88c Jul 06 15:28:56 devstack sudo[91766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-231b2ff1-70f3-4f2a-8561-ee331ff0e71a tempest-VolumesTestJSON-1597894362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:28:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-231b2ff1-70f3-4f2a-8561-ee331ff0e71a tempest-VolumesTestJSON-1597894362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-231b2ff1-70f3-4f2a-8561-ee331ff0e71a tempest-VolumesTestJSON-1597894362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:56 devstack sudo[91768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:28:56 devstack sudo[91768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a95b1735-10c5-4e2b-92c4-79935b19841f tempest-VolumesTestJSON-1597894362 None] Acquiring lock "cinder-d3cb4947-dc3f-4f53-b27d-912545c8f08e-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:28:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a95b1735-10c5-4e2b-92c4-79935b19841f tempest-VolumesTestJSON-1597894362 None] Lock "cinder-d3cb4947-dc3f-4f53-b27d-912545c8f08e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:28:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a95b1735-10c5-4e2b-92c4-79935b19841f tempest-VolumesTestJSON-1597894362 None] Acquiring lock "cinder-quobyte-d3cb4947-dc3f-4f53-b27d-912545c8f08e" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:28:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a95b1735-10c5-4e2b-92c4-79935b19841f tempest-VolumesTestJSON-1597894362 None] Lock "cinder-quobyte-d3cb4947-dc3f-4f53-b27d-912545c8f08e" acquired by "delete_volume" :: waited 0.017s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:28:56 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38abcba-f5b4-4801-884f-1fd92cbb276a]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:28:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a95b1735-10c5-4e2b-92c4-79935b19841f tempest-VolumesTestJSON-1597894362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3cb4947-dc3f-4f53-b27d-912545c8f08e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:56 devstack sudo[91768]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-231b2ff1-70f3-4f2a-8561-ee331ff0e71a tempest-VolumesTestJSON-1597894362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.711s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:56 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-231b2ff1-70f3-4f2a-8561-ee331ff0e71a tempest-VolumesTestJSON-1597894362 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:28:56 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-231b2ff1-70f3-4f2a-8561-ee331ff0e71a tempest-VolumesTestJSON-1597894362 None] Deleted volume successfully. Jul 06 15:28:56 devstack sudo[91771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3cb4947-dc3f-4f53-b27d-912545c8f08e Jul 06 15:28:56 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-231b2ff1-70f3-4f2a-8561-ee331ff0e71a tempest-VolumesTestJSON-1597894362 None] Lock "cinder-928545b3-f57e-47e9-bde3-4312e53d1908-delete_volume" released by "delete_volume" :: held 2.510s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:28:57 devstack sudo[91766]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8eddba33-6286-4d5e-8ec5-8acf8bfaf49e tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.6fc87e4c-0ce1-4810-9956-21a7f956f88c" returned: 0 in 0.854s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:57 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-8eddba33-6286-4d5e-8ec5-8acf8bfaf49e tempest-VolumesDeleteCascade-817725185 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.6fc87e4c-0ce1-4810-9956-21a7f956f88c is being set with open permissions: ugo+rw Jul 06 15:28:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8eddba33-6286-4d5e-8ec5-8acf8bfaf49e tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.6fc87e4c-0ce1-4810-9956-21a7f956f88c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:57 devstack sudo[91776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.6fc87e4c-0ce1-4810-9956-21a7f956f88c Jul 06 15:28:57 devstack sudo[91776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:57 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a95b1735-10c5-4e2b-92c4-79935b19841f tempest-VolumesTestJSON-1597894362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3cb4947-dc3f-4f53-b27d-912545c8f08e" returned: 0 in 0.805s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a95b1735-10c5-4e2b-92c4-79935b19841f tempest-VolumesTestJSON-1597894362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3cb4947-dc3f-4f53-b27d-912545c8f08e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:57 devstack sudo[91782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3cb4947-dc3f-4f53-b27d-912545c8f08e Jul 06 15:28:57 devstack sudo[91782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:57 devstack sudo[91776]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8eddba33-6286-4d5e-8ec5-8acf8bfaf49e tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.6fc87e4c-0ce1-4810-9956-21a7f956f88c" returned: 0 in 0.677s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8eddba33-6286-4d5e-8ec5-8acf8bfaf49e tempest-VolumesDeleteCascade-817725185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.422s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:57 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-8eddba33-6286-4d5e-8ec5-8acf8bfaf49e tempest-VolumesDeleteCascade-817725185 None] Create snapshot completed successfully Jul 06 15:28:58 devstack sudo[91782]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a95b1735-10c5-4e2b-92c4-79935b19841f tempest-VolumesTestJSON-1597894362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3cb4947-dc3f-4f53-b27d-912545c8f08e" returned: 0 in 0.678s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:58 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a95b1735-10c5-4e2b-92c4-79935b19841f tempest-VolumesTestJSON-1597894362 None] Lock "cinder-quobyte-d3cb4947-dc3f-4f53-b27d-912545c8f08e" released by "delete_volume" :: held 1.527s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:28:58 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-a95b1735-10c5-4e2b-92c4-79935b19841f tempest-VolumesTestJSON-1597894362 None] Created reservations ['272ec6f6-a673-423e-8630-e3e3b895d3d1', '23beffb9-ee0f-4569-ac4c-280a0e2ddfaa', 'cc8a27da-0026-4026-994b-7e0519fb9c6b', 'fac69e43-9287-4b33-bec1-084934dcce3f'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:28:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a95b1735-10c5-4e2b-92c4-79935b19841f tempest-VolumesTestJSON-1597894362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a95b1735-10c5-4e2b-92c4-79935b19841f tempest-VolumesTestJSON-1597894362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:58 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a95b1735-10c5-4e2b-92c4-79935b19841f tempest-VolumesTestJSON-1597894362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:28:58 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a95b1735-10c5-4e2b-92c4-79935b19841f tempest-VolumesTestJSON-1597894362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:28:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a95b1735-10c5-4e2b-92c4-79935b19841f tempest-VolumesTestJSON-1597894362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a95b1735-10c5-4e2b-92c4-79935b19841f tempest-VolumesTestJSON-1597894362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:58 devstack sudo[91786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:28:58 devstack sudo[91786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:58 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "cinder-61dd0380-0e1c-4734-a285-58618066b4a3-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:28:58 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-61dd0380-0e1c-4734-a285-58618066b4a3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:28:58 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Performing cascade delete. {{(pid=86148) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 06 15:28:58 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "cinder-5917ca7a-387c-41fb-9e13-a33b74b21b3e-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:28:58 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-5917ca7a-387c-41fb-9e13-a33b74b21b3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:28:58 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "cinder-quobyte-61dd0380-0e1c-4734-a285-58618066b4a3" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:28:58 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-quobyte-61dd0380-0e1c-4734-a285-58618066b4a3" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:28:58 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "cinder-quobyte-5917ca7a-387c-41fb-9e13-a33b74b21b3e" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:28:58 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-quobyte-5917ca7a-387c-41fb-9e13-a33b74b21b3e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:28:58 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Deleting offline snapshot 5917ca7a-387c-41fb-9e13-a33b74b21b3e of volume 61dd0380-0e1c-4734-a285-58618066b4a3 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:28:58 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] snapshot_file for this snap is: volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:28:58 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b55a97-8ad4-4d89-b7a9-cf8dc5fe5093]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:28:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:59 devstack sudo[91789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e Jul 06 15:28:59 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a654d976-a97e-436c-a20e-8fa7f2448180 tempest-VolumesTestJSON-1597894362 None] Acquiring lock "cinder-5763c9d5-0b9f-44a6-90e7-c240182c37cd-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:28:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a654d976-a97e-436c-a20e-8fa7f2448180 tempest-VolumesTestJSON-1597894362 None] Lock "cinder-5763c9d5-0b9f-44a6-90e7-c240182c37cd-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:28:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a654d976-a97e-436c-a20e-8fa7f2448180 tempest-VolumesTestJSON-1597894362 None] Acquiring lock "cinder-quobyte-5763c9d5-0b9f-44a6-90e7-c240182c37cd" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:28:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a654d976-a97e-436c-a20e-8fa7f2448180 tempest-VolumesTestJSON-1597894362 None] Lock "cinder-quobyte-5763c9d5-0b9f-44a6-90e7-c240182c37cd" acquired by "delete_volume" :: waited 0.029s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:28:59 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[90573fe0-eb81-4d47-be16-18c4c1c95f20]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:28:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a654d976-a97e-436c-a20e-8fa7f2448180 tempest-VolumesTestJSON-1597894362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5763c9d5-0b9f-44a6-90e7-c240182c37cd {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:59 devstack sudo[91786]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a95b1735-10c5-4e2b-92c4-79935b19841f tempest-VolumesTestJSON-1597894362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.907s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:59 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-a95b1735-10c5-4e2b-92c4-79935b19841f tempest-VolumesTestJSON-1597894362 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:28:59 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a95b1735-10c5-4e2b-92c4-79935b19841f tempest-VolumesTestJSON-1597894362 None] Deleted volume successfully. Jul 06 15:28:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a95b1735-10c5-4e2b-92c4-79935b19841f tempest-VolumesTestJSON-1597894362 None] Lock "cinder-d3cb4947-dc3f-4f53-b27d-912545c8f08e-delete_volume" released by "delete_volume" :: held 2.687s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:28:59 devstack sudo[91792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5763c9d5-0b9f-44a6-90e7-c240182c37cd Jul 06 15:28:59 devstack sudo[91792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:59 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e" returned: 0 in 1.054s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:59 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61dd0380-0e1c-4734-a285-58618066b4a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:28:59 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bd0b54-9c1c-4d26-8d04-3a556c69beaf]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:28:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:00 devstack sudo[91800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3 Jul 06 15:29:00 devstack sudo[91800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:00 devstack sudo[91792]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a654d976-a97e-436c-a20e-8fa7f2448180 tempest-VolumesTestJSON-1597894362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5763c9d5-0b9f-44a6-90e7-c240182c37cd" returned: 0 in 0.849s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a654d976-a97e-436c-a20e-8fa7f2448180 tempest-VolumesTestJSON-1597894362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5763c9d5-0b9f-44a6-90e7-c240182c37cd {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:00 devstack sudo[91805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5763c9d5-0b9f-44a6-90e7-c240182c37cd Jul 06 15:29:00 devstack sudo[91805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:00 devstack sudo[91800]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3" returned: 0 in 0.804s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:00 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39cc0b7-f858-4389-8c7e-37616c90b7f0]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:29:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.6fc87e4c-0ce1-4810-9956-21a7f956f88c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:00 devstack sudo[91805]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a654d976-a97e-436c-a20e-8fa7f2448180 tempest-VolumesTestJSON-1597894362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5763c9d5-0b9f-44a6-90e7-c240182c37cd" returned: 0 in 0.738s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:00 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a654d976-a97e-436c-a20e-8fa7f2448180 tempest-VolumesTestJSON-1597894362 None] Lock "cinder-quobyte-5763c9d5-0b9f-44a6-90e7-c240182c37cd" released by "delete_volume" :: held 1.640s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:00 devstack sudo[91818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.6fc87e4c-0ce1-4810-9956-21a7f956f88c Jul 06 15:29:00 devstack sudo[91818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:01 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-a654d976-a97e-436c-a20e-8fa7f2448180 tempest-VolumesTestJSON-1597894362 None] Created reservations ['943c92fb-3ea9-46cf-8c51-faede0aa5492', '205436d0-5dbe-49dc-abb6-30a91cc40998', 'e44a3cb4-8b8b-43da-9c20-d55be79f0b2d', 'ad7aee7b-f356-4183-bb0e-aaae5cb4ed94'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:29:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a654d976-a97e-436c-a20e-8fa7f2448180 tempest-VolumesTestJSON-1597894362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a654d976-a97e-436c-a20e-8fa7f2448180 tempest-VolumesTestJSON-1597894362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a654d976-a97e-436c-a20e-8fa7f2448180 tempest-VolumesTestJSON-1597894362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:29:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a654d976-a97e-436c-a20e-8fa7f2448180 tempest-VolumesTestJSON-1597894362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:29:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a654d976-a97e-436c-a20e-8fa7f2448180 tempest-VolumesTestJSON-1597894362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a654d976-a97e-436c-a20e-8fa7f2448180 tempest-VolumesTestJSON-1597894362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:01 devstack sudo[91820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:29:01 devstack sudo[91820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:01 devstack sudo[91818]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.6fc87e4c-0ce1-4810-9956-21a7f956f88c" returned: 0 in 0.952s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61dd0380-0e1c-4734-a285-58618066b4a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:29:01 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[65369b51-a51a-4470-a0fd-ad8b6ecb5680]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:29:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:02 devstack sudo[91820]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a654d976-a97e-436c-a20e-8fa7f2448180 tempest-VolumesTestJSON-1597894362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.942s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:02 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-a654d976-a97e-436c-a20e-8fa7f2448180 tempest-VolumesTestJSON-1597894362 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:29:02 devstack sudo[91831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e Jul 06 15:29:02 devstack sudo[91831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:02 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a654d976-a97e-436c-a20e-8fa7f2448180 tempest-VolumesTestJSON-1597894362 None] Deleted volume successfully. Jul 06 15:29:02 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a654d976-a97e-436c-a20e-8fa7f2448180 tempest-VolumesTestJSON-1597894362 None] Lock "cinder-5763c9d5-0b9f-44a6-90e7-c240182c37cd-delete_volume" released by "delete_volume" :: held 2.917s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:02 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-024f1690-bb9d-4305-9d5f-7ef41747e6f6 req-68c281bd-7ab8-43e6-a4a5-89f2ec2976a5 tempest-ServerActionsTestOtherA-2083244986 None] Terminate volume connection completed successfully. Jul 06 15:29:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-024f1690-bb9d-4305-9d5f-7ef41747e6f6 req-68c281bd-7ab8-43e6-a4a5-89f2ec2976a5 tempest-ServerActionsTestOtherA-2083244986 None] Deleting attachment 2a197c1d-3c8a-47d5-aa79-a631f5a61684. {{(pid=86148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:29:02 devstack sudo[91831]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e" returned: 0 in 1.077s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:02 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61dd0380-0e1c-4734-a285-58618066b4a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:29:02 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa654ee-f67d-4c06-9b7d-ce67731471f5]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:29:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:03 devstack sudo[91863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3 Jul 06 15:29:03 devstack sudo[91863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:04 devstack sudo[91863]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3" returned: 0 in 1.187s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:04 devstack sudo[91888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e Jul 06 15:29:04 devstack sudo[91888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-024f1690-bb9d-4305-9d5f-7ef41747e6f6 req-a58f92da-9f91-45d0-9701-ae0f1520be3c tempest-ServerActionsTestOtherA-2083244986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-024f1690-bb9d-4305-9d5f-7ef41747e6f6 req-a58f92da-9f91-45d0-9701-ae0f1520be3c tempest-ServerActionsTestOtherA-2083244986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:05 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce73e0c8-3c8b-426c-ae8e-e8cad1a28a44]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:29:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-024f1690-bb9d-4305-9d5f-7ef41747e6f6 req-a58f92da-9f91-45d0-9701-ae0f1520be3c tempest-ServerActionsTestOtherA-2083244986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0c457ae1-17fe-49f5-ba43-deeeb54f9553 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:05 devstack sudo[91888]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e" returned: 0 in 1.004s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:05 devstack sudo[91902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0c457ae1-17fe-49f5-ba43-deeeb54f9553 Jul 06 15:29:05 devstack sudo[91902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:05 devstack sudo[91903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e Jul 06 15:29:05 devstack sudo[91903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:05 devstack sudo[91902]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-024f1690-bb9d-4305-9d5f-7ef41747e6f6 req-a58f92da-9f91-45d0-9701-ae0f1520be3c tempest-ServerActionsTestOtherA-2083244986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0c457ae1-17fe-49f5-ba43-deeeb54f9553" returned: 0 in 0.793s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-024f1690-bb9d-4305-9d5f-7ef41747e6f6 req-a58f92da-9f91-45d0-9701-ae0f1520be3c tempest-ServerActionsTestOtherA-2083244986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.813s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-024f1690-bb9d-4305-9d5f-7ef41747e6f6 req-a58f92da-9f91-45d0-9701-ae0f1520be3c tempest-ServerActionsTestOtherA-2083244986 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce', 'name': 'volume-0c457ae1-17fe-49f5-ba43-deeeb54f9553', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '05aafe60-96fd-40f6-8914-470ccbc3685d', 'enforce_multipath': True} {{(pid=86148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:29:05 devstack sudo[91903]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.5917ca7a-387c-41fb-9e13-a33b74b21b3e" returned: 0 in 0.779s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61dd0380-0e1c-4734-a285-58618066b4a3 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.6fc87e4c-0ce1-4810-9956-21a7f956f88c -F qcow2 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:05 devstack sudo[91910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61dd0380-0e1c-4734-a285-58618066b4a3 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.6fc87e4c-0ce1-4810-9956-21a7f956f88c -F qcow2 Jul 06 15:29:05 devstack sudo[91910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:05 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-024f1690-bb9d-4305-9d5f-7ef41747e6f6 req-a58f92da-9f91-45d0-9701-ae0f1520be3c tempest-ServerActionsTestOtherA-2083244986 None] attachment_update completed successfully. Jul 06 15:29:06 devstack sudo[91910]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61dd0380-0e1c-4734-a285-58618066b4a3 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.6fc87e4c-0ce1-4810-9956-21a7f956f88c -F qcow2" returned: 0 in 0.795s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:06 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-quobyte-5917ca7a-387c-41fb-9e13-a33b74b21b3e" released by "_delete_snapshot" :: held 7.876s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:06 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-quobyte-61dd0380-0e1c-4734-a285-58618066b4a3" released by "delete_snapshot" :: held 7.905s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:06 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Created reservations ['c2ea8a80-7603-4e7f-bd5e-28bdce3be26c', '1b06e9da-0753-4a75-b4c7-ace337fe3d9f', 'dc6ba5fd-1fc7-4db3-9c3d-20c61a9c668c', '5567298a-3ccc-4bee-be53-4e9d7361cd38'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:29:06 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Delete snapshot completed successfully. Jul 06 15:29:06 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-5917ca7a-387c-41fb-9e13-a33b74b21b3e-delete_snapshot" released by "delete_snapshot" :: held 8.137s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:06 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "cinder-6fc87e4c-0ce1-4810-9956-21a7f956f88c-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:06 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-6fc87e4c-0ce1-4810-9956-21a7f956f88c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:06 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "cinder-quobyte-61dd0380-0e1c-4734-a285-58618066b4a3" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:06 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-quobyte-61dd0380-0e1c-4734-a285-58618066b4a3" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:06 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "cinder-quobyte-6fc87e4c-0ce1-4810-9956-21a7f956f88c" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:06 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-quobyte-6fc87e4c-0ce1-4810-9956-21a7f956f88c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:06 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Deleting offline snapshot 6fc87e4c-0ce1-4810-9956-21a7f956f88c of volume 61dd0380-0e1c-4734-a285-58618066b4a3 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:29:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] snapshot_file for this snap is: volume-61dd0380-0e1c-4734-a285-58618066b4a3.6fc87e4c-0ce1-4810-9956-21a7f956f88c {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:29:07 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb6891b-57ec-41bd-9d98-7773bcf71842]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:29:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.6fc87e4c-0ce1-4810-9956-21a7f956f88c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:07 devstack sudo[91916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.6fc87e4c-0ce1-4810-9956-21a7f956f88c Jul 06 15:29:07 devstack sudo[91916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:08 devstack sudo[91916]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.6fc87e4c-0ce1-4810-9956-21a7f956f88c" returned: 0 in 1.143s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61dd0380-0e1c-4734-a285-58618066b4a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:29:08 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[843aae8e-cdde-4789-8b3c-9f6b4b127888]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:29:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:08 devstack sudo[91949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3 Jul 06 15:29:08 devstack sudo[91949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:09 devstack sudo[91949]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3" returned: 0 in 0.985s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.6fc87e4c-0ce1-4810-9956-21a7f956f88c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:09 devstack sudo[92029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.6fc87e4c-0ce1-4810-9956-21a7f956f88c Jul 06 15:29:09 devstack sudo[92029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:10 devstack sudo[92029]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.6fc87e4c-0ce1-4810-9956-21a7f956f88c" returned: 0 in 1.047s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.6fc87e4c-0ce1-4810-9956-21a7f956f88c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:10 devstack sudo[92059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.6fc87e4c-0ce1-4810-9956-21a7f956f88c Jul 06 15:29:10 devstack sudo[92059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:11 devstack sudo[92059]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3.6fc87e4c-0ce1-4810-9956-21a7f956f88c" returned: 0 in 1.042s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:11 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-quobyte-6fc87e4c-0ce1-4810-9956-21a7f956f88c" released by "_delete_snapshot" :: held 4.350s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:11 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-quobyte-61dd0380-0e1c-4734-a285-58618066b4a3" released by "delete_snapshot" :: held 4.379s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:11 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Created reservations ['9fd9d6f3-43e3-4b6e-8fa6-eb9a78b80df2', 'a68bcb76-d849-4939-8d93-5f78e568a33b', '64cdf8fa-c533-4321-9e19-6ddd118e4f4a', '5b760a58-a288-4e28-9d0a-37ab11020d3a'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:29:11 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Delete snapshot completed successfully. Jul 06 15:29:11 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-6fc87e4c-0ce1-4810-9956-21a7f956f88c-delete_snapshot" released by "delete_snapshot" :: held 4.647s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Snapshots deleted, issuing volume delete {{(pid=86148) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 06 15:29:11 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "cinder-quobyte-61dd0380-0e1c-4734-a285-58618066b4a3" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:11 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-quobyte-61dd0380-0e1c-4734-a285-58618066b4a3" acquired by "delete_volume" :: waited 0.022s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:11 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[521ff659-866c-4f27-92d9-c5e8b123e4c2]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:29:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:11 devstack sudo[92451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3 Jul 06 15:29:11 devstack sudo[92451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:13 devstack sudo[92451]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3" returned: 0 in 1.405s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:13 devstack sudo[92475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3 Jul 06 15:29:13 devstack sudo[92475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:14 devstack sudo[92475]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-61dd0380-0e1c-4734-a285-58618066b4a3" returned: 0 in 1.060s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-quobyte-61dd0380-0e1c-4734-a285-58618066b4a3" released by "delete_volume" :: held 2.627s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:14 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Created reservations ['9d907141-191e-48ae-bd42-810397977adf', 'a15325ba-5103-444d-8c22-94ae82a0bf15', '0098a2a7-8498-47f4-9a26-f1efd02d3a59', '04359c94-00f7-4264-8fc5-d8595d609839'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:29:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:29:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:29:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:14 devstack sudo[92481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:29:14 devstack sudo[92481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:15 devstack sudo[92481]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.239s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:15 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:29:15 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Deleted volume successfully. Jul 06 15:29:15 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9b8d6cef-3a28-4fa5-b1ed-89c284b68119 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-61dd0380-0e1c-4734-a285-58618066b4a3-delete_volume" released by "delete_volume" :: held 17.076s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:16 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:29:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Flow 'volume_create_manager' (5f9c3188-35aa-45a5-9a09-35fe979cebe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:29:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e186f895-c75c-4d58-8331-459bca883378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e186f895-c75c-4d58-8331-459bca883378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-687045883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa14902-67ae-4f7e-909c-4713f4303b65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7517620e6c0445c596e212b54fe362b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:29:17Z,use_quota=True,user_id='109b1ba5ab5348b1b153d833251cb0e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30c5dd96-5f25-4787-a4fc-0ed264d48635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30c5dd96-5f25-4787-a4fc-0ed264d48635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:17 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90c7ac9-1b16-4b2d-9948-fee6510f4d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:17 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90c7ac9-1b16-4b2d-9948-fee6510f4d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fa14902-67ae-4f7e-909c-4713f4303b65', 'volume_name': 'volume-6fa14902-67ae-4f7e-909c-4713f4303b65', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:17 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d33197-8056-4b1a-88d4-c7ee9bfd7343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:17 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d33197-8056-4b1a-88d4-c7ee9bfd7343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:17 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5059aea9-f53b-4901-9486-bad08d53bfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:17 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Volume 6fa14902-67ae-4f7e-909c-4713f4303b65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fa14902-67ae-4f7e-909c-4713f4303b65', 'volume_size': 1} Jul 06 15:29:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:17 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-687045883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa14902-67ae-4f7e-909c-4713f4303b65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7517620e6c0445c596e212b54fe362b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:29:17Z,use_quota=True,user_id='109b1ba5ab5348b1b153d833251cb0e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:29:17 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Creating volume 6fa14902-67ae-4f7e-909c-4713f4303b65 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:29:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:17 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:29:17 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:29:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:17 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:29:17 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:29:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:17 devstack sudo[92484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65 1073741824 Jul 06 15:29:17 devstack sudo[92484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:18 devstack sudo[92484]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65 1073741824" returned: 0 in 0.970s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:18 devstack sudo[92490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65 Jul 06 15:29:18 devstack sudo[92490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:18 devstack sudo[92490]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65" returned: 0 in 0.718s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:18 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:29:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:18 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5059aea9-f53b-4901-9486-bad08d53bfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fa14902-67ae-4f7e-909c-4713f4303b65', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:18 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbbeb84b-b7f2-402a-aa03-68b122d9bbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:18 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Volume volume-6fa14902-67ae-4f7e-909c-4713f4303b65 (6fa14902-67ae-4f7e-909c-4713f4303b65): created successfully Jul 06 15:29:18 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbbeb84b-b7f2-402a-aa03-68b122d9bbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:18 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Flow 'volume_create_manager' (5f9c3188-35aa-45a5-9a09-35fe979cebe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:29:18 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-9506ae0f-a8aa-4f8c-ac1d-4b6ae1777bef tempest-VolumesDeleteCascade-817725185 None] Created volume successfully. Jul 06 15:29:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-516a6512-dce0-436a-b5f2-432a31ae799c tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-516a6512-dce0-436a-b5f2-432a31ae799c tempest-VolumesDeleteCascade-817725185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:19 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-516a6512-dce0-436a-b5f2-432a31ae799c tempest-VolumesDeleteCascade-817725185 None] Creating offline snapshot 15b67918-364a-4ca3-b002-1d3a31df56fb of volume 6fa14902-67ae-4f7e-909c-4713f4303b65 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:29:19 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2b43ee-7ebf-4b93-8feb-d24641d8a23f]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:29:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-516a6512-dce0-436a-b5f2-432a31ae799c tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:19 devstack sudo[92494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65 Jul 06 15:29:19 devstack sudo[92494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:20 devstack sudo[92494]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-516a6512-dce0-436a-b5f2-432a31ae799c tempest-VolumesDeleteCascade-817725185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65" returned: 0 in 1.102s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-516a6512-dce0-436a-b5f2-432a31ae799c tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.15b67918-364a-4ca3-b002-1d3a31df56fb 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:20 devstack sudo[92499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.15b67918-364a-4ca3-b002-1d3a31df56fb 1G Jul 06 15:29:20 devstack sudo[92499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:21 devstack sudo[92499]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-516a6512-dce0-436a-b5f2-432a31ae799c tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.15b67918-364a-4ca3-b002-1d3a31df56fb 1G" returned: 0 in 1.112s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-516a6512-dce0-436a-b5f2-432a31ae799c tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa14902-67ae-4f7e-909c-4713f4303b65 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.15b67918-364a-4ca3-b002-1d3a31df56fb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:21 devstack sudo[92505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa14902-67ae-4f7e-909c-4713f4303b65 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.15b67918-364a-4ca3-b002-1d3a31df56fb Jul 06 15:29:21 devstack sudo[92505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:22 devstack sudo[92505]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-516a6512-dce0-436a-b5f2-432a31ae799c tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa14902-67ae-4f7e-909c-4713f4303b65 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.15b67918-364a-4ca3-b002-1d3a31df56fb" returned: 0 in 0.764s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:22 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-516a6512-dce0-436a-b5f2-432a31ae799c tempest-VolumesDeleteCascade-817725185 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.15b67918-364a-4ca3-b002-1d3a31df56fb is being set with open permissions: ugo+rw Jul 06 15:29:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-516a6512-dce0-436a-b5f2-432a31ae799c tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.15b67918-364a-4ca3-b002-1d3a31df56fb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:22 devstack sudo[92511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.15b67918-364a-4ca3-b002-1d3a31df56fb Jul 06 15:29:22 devstack sudo[92511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:22 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:29:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Flow 'volume_create_manager' (6f8c0318-3219-416e-8b4a-489690485328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:29:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e007c7d9-a61a-44cf-81a3-a091e841d41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e007c7d9-a61a-44cf-81a3-a091e841d41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-959040452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce2cf11-642e-474f-9413-8209d95a93d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15195416d6ac4aefad2b2ef216fc9edc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:29:23Z,use_quota=True,user_id='a62fa5b81dc1495a892316c6aca4e203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32adf29b-40fc-4e62-936a-63b3732f188c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32adf29b-40fc-4e62-936a-63b3732f188c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f3b84b-036d-474f-9185-3c62c67f4fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f3b84b-036d-474f-9185-3c62c67f4fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ce2cf11-642e-474f-9413-8209d95a93d6', 'volume_name': 'volume-9ce2cf11-642e-474f-9413-8209d95a93d6', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31bb79e1-293f-43e8-9b87-718421e84ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31bb79e1-293f-43e8-9b87-718421e84ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff002933-a2bf-4825-9a09-97876143e7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:23 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Volume 9ce2cf11-642e-474f-9413-8209d95a93d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ce2cf11-642e-474f-9413-8209d95a93d6', 'volume_size': 1} Jul 06 15:29:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:23 devstack sudo[92511]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-516a6512-dce0-436a-b5f2-432a31ae799c tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.15b67918-364a-4ca3-b002-1d3a31df56fb" returned: 0 in 0.876s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-516a6512-dce0-436a-b5f2-432a31ae799c tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:23 devstack sudo[92514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.info Jul 06 15:29:23 devstack sudo[92514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:23 devstack sudo[92514]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-516a6512-dce0-436a-b5f2-432a31ae799c tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.info" returned: 0 in 0.664s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:23 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-516a6512-dce0-436a-b5f2-432a31ae799c tempest-VolumesDeleteCascade-817725185 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.info is being set with open permissions: ugo+rw Jul 06 15:29:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-516a6512-dce0-436a-b5f2-432a31ae799c tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:23 devstack sudo[92517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.info Jul 06 15:29:23 devstack sudo[92517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:24 devstack sudo[92517]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-516a6512-dce0-436a-b5f2-432a31ae799c tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.info" returned: 0 in 0.633s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-516a6512-dce0-436a-b5f2-432a31ae799c tempest-VolumesDeleteCascade-817725185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.251s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.497s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-959040452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce2cf11-642e-474f-9413-8209d95a93d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15195416d6ac4aefad2b2ef216fc9edc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:29:23Z,use_quota=True,user_id='a62fa5b81dc1495a892316c6aca4e203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:29:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Creating volume 9ce2cf11-642e-474f-9413-8209d95a93d6 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:29:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:29:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:29:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:29:24 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:29:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9ce2cf11-642e-474f-9413-8209d95a93d6 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:24 devstack sudo[92520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9ce2cf11-642e-474f-9413-8209d95a93d6 1073741824 Jul 06 15:29:24 devstack sudo[92520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:24 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-516a6512-dce0-436a-b5f2-432a31ae799c tempest-VolumesDeleteCascade-817725185 None] Create snapshot completed successfully Jul 06 15:29:25 devstack sudo[92520]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9ce2cf11-642e-474f-9413-8209d95a93d6 1073741824" returned: 0 in 0.825s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9ce2cf11-642e-474f-9413-8209d95a93d6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:25 devstack sudo[92525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9ce2cf11-642e-474f-9413-8209d95a93d6 Jul 06 15:29:25 devstack sudo[92525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:26 devstack sudo[92525]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9ce2cf11-642e-474f-9413-8209d95a93d6" returned: 0 in 0.682s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff002933-a2bf-4825-9a09-97876143e7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ce2cf11-642e-474f-9413-8209d95a93d6', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e584d1f-0702-4e08-8cf6-e6bd4ad515c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:26 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Volume volume-9ce2cf11-642e-474f-9413-8209d95a93d6 (9ce2cf11-642e-474f-9413-8209d95a93d6): created successfully Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e584d1f-0702-4e08-8cf6-e6bd4ad515c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Flow 'volume_create_manager' (6f8c0318-3219-416e-8b4a-489690485328) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:29:26 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-e4983593-d912-4293-a847-57a8f55007f8 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Created volume successfully. Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Flow 'volume_create_manager' (940498c7-1233-4ad1-af21-744456012036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468ec606-b4e9-44b4-812e-e4110980fdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468ec606-b4e9-44b4-812e-e4110980fdea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1580241061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=debc111f-1a82-4926-9933-cfa1404af107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7517620e6c0445c596e212b54fe362b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=15b67918-364a-4ca3-b002-1d3a31df56fb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:29:26Z,use_quota=True,user_id='109b1ba5ab5348b1b153d833251cb0e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc475ff-f23c-4b03-94ec-62618b668767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc475ff-f23c-4b03-94ec-62618b668767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d0a4e91-921f-42a6-80c8-3260ff36061a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d0a4e91-921f-42a6-80c8-3260ff36061a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'debc111f-1a82-4926-9933-cfa1404af107', 'volume_name': 'volume-debc111f-1a82-4926-9933-cfa1404af107', 'volume_size': 1, 'snapshot_id': '15b67918-364a-4ca3-b002-1d3a31df56fb'}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c0c7e1-ea1c-40d0-ad24-2c090da4616e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c0c7e1-ea1c-40d0-ad24-2c090da4616e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4eb99d6-8a74-4c80-88fb-5854a9a3e40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:26 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Volume debc111f-1a82-4926-9933-cfa1404af107: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-debc111f-1a82-4926-9933-cfa1404af107', 'volume_size': 1, 'snapshot_id': '15b67918-364a-4ca3-b002-1d3a31df56fb'} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "cinder-quobyte-15b67918-364a-4ca3-b002-1d3a31df56fb-debc111f-1a82-4926-9933-cfa1404af107" by "_create_volume_from_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-quobyte-15b67918-364a-4ca3-b002-1d3a31df56fb-debc111f-1a82-4926-9933-cfa1404af107" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Creating volume debc111f-1a82-4926-9933-cfa1404af107 from snapshot 15b67918-364a-4ca3-b002-1d3a31df56fb {{(pid=86148) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "cinder-quobyte-debc111f-1a82-4926-9933-cfa1404af107" by "_copy_volume_from_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-quobyte-debc111f-1a82-4926-9933-cfa1404af107" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] snapshot: 15b67918-364a-4ca3-b002-1d3a31df56fb, volume: debc111f-1a82-4926-9933-cfa1404af107, {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf47e98-b9d9-48c6-bc92-b66601b188d4]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:29:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.15b67918-364a-4ca3-b002-1d3a31df56fb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:26 devstack sudo[92539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.15b67918-364a-4ca3-b002-1d3a31df56fb Jul 06 15:29:26 devstack sudo[92539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:27 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6b22ac93-e7a1-41e6-9c74-a877c9c158f2 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Acquiring lock "cinder-9ce2cf11-642e-474f-9413-8209d95a93d6-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:27 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6b22ac93-e7a1-41e6-9c74-a877c9c158f2 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Lock "cinder-9ce2cf11-642e-474f-9413-8209d95a93d6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:27 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6b22ac93-e7a1-41e6-9c74-a877c9c158f2 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Acquiring lock "cinder-quobyte-9ce2cf11-642e-474f-9413-8209d95a93d6" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:27 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6b22ac93-e7a1-41e6-9c74-a877c9c158f2 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Lock "cinder-quobyte-9ce2cf11-642e-474f-9413-8209d95a93d6" acquired by "delete_volume" :: waited 0.022s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:27 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c960982-a29a-4e67-b688-3698cb50a908]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:29:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6b22ac93-e7a1-41e6-9c74-a877c9c158f2 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9ce2cf11-642e-474f-9413-8209d95a93d6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:27 devstack sudo[92539]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.15b67918-364a-4ca3-b002-1d3a31df56fb" returned: 0 in 0.863s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:27 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fa14902-67ae-4f7e-909c-4713f4303b65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:29:27 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65 {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 15:29:27 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Creating direct copy from snapshot {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 15:29:27 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ed479f-a493-430b-bb97-c09439164fc8]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:29:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:27 devstack sudo[92555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9ce2cf11-642e-474f-9413-8209d95a93d6 Jul 06 15:29:27 devstack sudo[92555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:27 devstack sudo[92566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65 Jul 06 15:29:27 devstack sudo[92566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:28 devstack sudo[92555]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6b22ac93-e7a1-41e6-9c74-a877c9c158f2 tempest-VolumeQuotasAdminTestJSON-1937825818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9ce2cf11-642e-474f-9413-8209d95a93d6" returned: 0 in 0.813s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6b22ac93-e7a1-41e6-9c74-a877c9c158f2 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9ce2cf11-642e-474f-9413-8209d95a93d6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:28 devstack sudo[92576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9ce2cf11-642e-474f-9413-8209d95a93d6 Jul 06 15:29:28 devstack sudo[92576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:28 devstack sudo[92566]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65" returned: 0 in 0.792s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:28 devstack cinder-volume[86148]: DEBUG cinder.utils [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Path /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-debc111f-1a82-4926-9933-cfa1404af107 not found in is_blk_device check {{(pid=86148) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 15:29:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-debc111f-1a82-4926-9933-cfa1404af107 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:28 devstack sudo[92578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-debc111f-1a82-4926-9933-cfa1404af107 Jul 06 15:29:28 devstack sudo[92578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:28 devstack sudo[92576]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6b22ac93-e7a1-41e6-9c74-a877c9c158f2 tempest-VolumeQuotasAdminTestJSON-1937825818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9ce2cf11-642e-474f-9413-8209d95a93d6" returned: 0 in 0.640s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:28 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6b22ac93-e7a1-41e6-9c74-a877c9c158f2 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Lock "cinder-quobyte-9ce2cf11-642e-474f-9413-8209d95a93d6" released by "delete_volume" :: held 1.503s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:28 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=88,cinder:INSERT=21,cinder:UPDATE=86,cinder:DELETE=5 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:29:28 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=80,cinder:INSERT=20,cinder:UPDATE=92,cinder:DELETE=11 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:29:28 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-6b22ac93-e7a1-41e6-9c74-a877c9c158f2 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Created reservations ['1b1f0a44-8385-4883-9a31-2b91889250e7', '154954f0-18e0-4708-9dc4-e25c92e2b5f8', '56c09fd1-be4a-4949-8f03-294a8b4b2eef', '6869f044-26ca-480c-83c5-27657ef8d359'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:29:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6b22ac93-e7a1-41e6-9c74-a877c9c158f2 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6b22ac93-e7a1-41e6-9c74-a877c9c158f2 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:28 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6b22ac93-e7a1-41e6-9c74-a877c9c158f2 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:29:29 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6b22ac93-e7a1-41e6-9c74-a877c9c158f2 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:29:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6b22ac93-e7a1-41e6-9c74-a877c9c158f2 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6b22ac93-e7a1-41e6-9c74-a877c9c158f2 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:29 devstack sudo[92609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:29:29 devstack sudo[92609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:30 devstack sudo[92609]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6b22ac93-e7a1-41e6-9c74-a877c9c158f2 tempest-VolumeQuotasAdminTestJSON-1937825818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.302s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:30 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-6b22ac93-e7a1-41e6-9c74-a877c9c158f2 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:29:30 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-6b22ac93-e7a1-41e6-9c74-a877c9c158f2 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Deleted volume successfully. Jul 06 15:29:30 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6b22ac93-e7a1-41e6-9c74-a877c9c158f2 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Lock "cinder-9ce2cf11-642e-474f-9413-8209d95a93d6-delete_volume" released by "delete_volume" :: held 3.114s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:31 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:29:31 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Flow 'volume_create_manager' (0fc3d0bb-dc7e-4d17-b351-72ba7efbde71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:29:31 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5818b99-466b-4fbf-8f1f-310d7b510df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:31 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5818b99-466b-4fbf-8f1f-310d7b510df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1344640772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d240a0f-a4af-48d9-ad03-139dfb5384c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15195416d6ac4aefad2b2ef216fc9edc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:29:31Z,use_quota=True,user_id='a62fa5b81dc1495a892316c6aca4e203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:31 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb81def2-e971-468b-b27d-18b7983a3aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:31 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb81def2-e971-468b-b27d-18b7983a3aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:31 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d804b6-83b1-4297-8817-a7d0ab6ce1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:31 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d804b6-83b1-4297-8817-a7d0ab6ce1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d240a0f-a4af-48d9-ad03-139dfb5384c6', 'volume_name': 'volume-4d240a0f-a4af-48d9-ad03-139dfb5384c6', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:31 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec98492d-6f16-4696-a3d3-c313438cdd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:31 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec98492d-6f16-4696-a3d3-c313438cdd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:31 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38162454-a0c3-4328-bef2-a38b85c1ab6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:31 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Volume 4d240a0f-a4af-48d9-ad03-139dfb5384c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d240a0f-a4af-48d9-ad03-139dfb5384c6', 'volume_size': 1} Jul 06 15:29:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:33 devstack sudo[92578]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-debc111f-1a82-4926-9933-cfa1404af107" returned: 0 in 4.972s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:33 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1266f4-b655-425d-8d13-57e3e68ce77b]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:29:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:33 devstack sudo[92669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65 Jul 06 15:29:33 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:34 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65" returned: 0 in 0.951s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:34 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65, size 1024.00 MB, duration 4.97 sec, destination /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-debc111f-1a82-4926-9933-cfa1404af107 {{(pid=86148) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:29:34 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Converted 1024.00 MB image at 205.89 MB/s Jul 06 15:29:34 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-debc111f-1a82-4926-9933-cfa1404af107 is being set with open permissions: ugo+rw Jul 06 15:29:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-debc111f-1a82-4926-9933-cfa1404af107 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:34 devstack sudo[92676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-debc111f-1a82-4926-9933-cfa1404af107 Jul 06 15:29:34 devstack sudo[92676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:34 devstack sudo[92676]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-debc111f-1a82-4926-9933-cfa1404af107" returned: 0 in 0.662s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:34 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-quobyte-debc111f-1a82-4926-9933-cfa1404af107" released by "_copy_volume_from_snapshot" :: held 8.355s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:34 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-quobyte-15b67918-364a-4ca3-b002-1d3a31df56fb-debc111f-1a82-4926-9933-cfa1404af107" released by "_create_volume_from_snapshot" :: held 8.389s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.403s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.731s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1344640772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d240a0f-a4af-48d9-ad03-139dfb5384c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15195416d6ac4aefad2b2ef216fc9edc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:29:31Z,use_quota=True,user_id='a62fa5b81dc1495a892316c6aca4e203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:29:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Creating volume 4d240a0f-a4af-48d9-ad03-139dfb5384c6 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:29:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:29:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:29:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:29:34 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:29:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4d240a0f-a4af-48d9-ad03-139dfb5384c6 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:35 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4d240a0f-a4af-48d9-ad03-139dfb5384c6 1073741824 Jul 06 15:29:35 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4eb99d6-8a74-4c80-88fb-5854a9a3e40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-debc111f-1a82-4926-9933-cfa1404af107', 'volume_size': 1, 'snapshot_id': '15b67918-364a-4ca3-b002-1d3a31df56fb'}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4396b2a9-a74b-4068-bc0f-b65bf78bd9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:35 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Volume volume-debc111f-1a82-4926-9933-cfa1404af107 (debc111f-1a82-4926-9933-cfa1404af107): created successfully Jul 06 15:29:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4396b2a9-a74b-4068-bc0f-b65bf78bd9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Flow 'volume_create_manager' (940498c7-1233-4ad1-af21-744456012036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:29:35 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-919e9de7-d3f4-4581-9a67-85cf174c5ad0 tempest-VolumesDeleteCascade-817725185 None] Created volume successfully. Jul 06 15:29:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "cinder-6fa14902-67ae-4f7e-909c-4713f4303b65-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-6fa14902-67ae-4f7e-909c-4713f4303b65-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Performing cascade delete. {{(pid=86148) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 06 15:29:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "cinder-15b67918-364a-4ca3-b002-1d3a31df56fb-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-15b67918-364a-4ca3-b002-1d3a31df56fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "cinder-quobyte-6fa14902-67ae-4f7e-909c-4713f4303b65" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-quobyte-6fa14902-67ae-4f7e-909c-4713f4303b65" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "cinder-quobyte-15b67918-364a-4ca3-b002-1d3a31df56fb" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-quobyte-15b67918-364a-4ca3-b002-1d3a31df56fb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:35 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Deleting offline snapshot 15b67918-364a-4ca3-b002-1d3a31df56fb of volume 6fa14902-67ae-4f7e-909c-4713f4303b65 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:29:35 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] snapshot_file for this snap is: volume-6fa14902-67ae-4f7e-909c-4713f4303b65.15b67918-364a-4ca3-b002-1d3a31df56fb {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:29:35 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[229fa37b-7e05-4d0f-bf86-d15de303286d]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:29:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.15b67918-364a-4ca3-b002-1d3a31df56fb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:35 devstack sudo[92683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.15b67918-364a-4ca3-b002-1d3a31df56fb Jul 06 15:29:35 devstack sudo[92683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:35 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4d240a0f-a4af-48d9-ad03-139dfb5384c6 1073741824" returned: 0 in 0.961s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4d240a0f-a4af-48d9-ad03-139dfb5384c6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:36 devstack sudo[92689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4d240a0f-a4af-48d9-ad03-139dfb5384c6 Jul 06 15:29:36 devstack sudo[92689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:36 devstack sudo[92683]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.15b67918-364a-4ca3-b002-1d3a31df56fb" returned: 0 in 0.892s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fa14902-67ae-4f7e-909c-4713f4303b65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:29:36 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba24d66-4418-463f-9596-5fbd8f3e0716]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:29:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:36 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65 Jul 06 15:29:36 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:36 devstack sudo[92689]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4d240a0f-a4af-48d9-ad03-139dfb5384c6" returned: 0 in 0.729s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:29:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38162454-a0c3-4328-bef2-a38b85c1ab6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d240a0f-a4af-48d9-ad03-139dfb5384c6', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff18c971-4d26-4c7c-a91f-f26b2d8a132d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:36 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Volume volume-4d240a0f-a4af-48d9-ad03-139dfb5384c6 (4d240a0f-a4af-48d9-ad03-139dfb5384c6): created successfully Jul 06 15:29:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff18c971-4d26-4c7c-a91f-f26b2d8a132d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Flow 'volume_create_manager' (0fc3d0bb-dc7e-4d17-b351-72ba7efbde71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:29:36 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-4c005767-acd2-4f51-be63-66adb0f48db5 tempest-VolumeQuotasAdminTestJSON-1937825818 None] Created volume successfully. Jul 06 15:29:37 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65" returned: 0 in 0.847s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.15b67918-364a-4ca3-b002-1d3a31df56fb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:37 devstack sudo[92707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.15b67918-364a-4ca3-b002-1d3a31df56fb Jul 06 15:29:37 devstack sudo[92707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:37 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-7adc026c-fe57-4061-9f6d-6f3483fd06d1 req-91915f83-19c6-403e-b5c5-043afe0caa5a tempest-AttachVolumeTestJSON-1381247220 None] Terminate volume connection completed successfully. Jul 06 15:29:37 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-7adc026c-fe57-4061-9f6d-6f3483fd06d1 req-91915f83-19c6-403e-b5c5-043afe0caa5a tempest-AttachVolumeTestJSON-1381247220 None] Deleting attachment e1cc0022-4b1c-466b-84c0-ac67ea0dba43. {{(pid=86148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:29:38 devstack sudo[92707]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.15b67918-364a-4ca3-b002-1d3a31df56fb" returned: 0 in 0.776s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.15b67918-364a-4ca3-b002-1d3a31df56fb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:38 devstack sudo[92713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.15b67918-364a-4ca3-b002-1d3a31df56fb Jul 06 15:29:38 devstack sudo[92713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:38 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-8f83c202-5a50-48d7-b191-1cce3b45bbc5 tempest-VolumeQuotasAdminTestJSON-2110679241 None] Transfer volume completed successfully. Jul 06 15:29:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:29:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:29:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:29:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:38 devstack sudo[92716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:29:38 devstack sudo[92716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:38 devstack sudo[92713]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65.15b67918-364a-4ca3-b002-1d3a31df56fb" returned: 0 in 0.813s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:39 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-quobyte-15b67918-364a-4ca3-b002-1d3a31df56fb" released by "_delete_snapshot" :: held 3.440s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:39 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-quobyte-6fa14902-67ae-4f7e-909c-4713f4303b65" released by "delete_snapshot" :: held 3.463s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:39 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Created reservations ['ea1d2a93-fad0-49aa-9847-bdbbb8cccaac', '89943362-d0ce-4eca-90ed-09248c5091b3', 'a25a52ed-47f5-4b3d-b66a-4996bf66d0d5', 'd2b5ad40-ed40-4023-8746-e9ba9d58e883'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:29:39 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Delete snapshot completed successfully. Jul 06 15:29:39 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-15b67918-364a-4ca3-b002-1d3a31df56fb-delete_snapshot" released by "delete_snapshot" :: held 3.667s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Snapshots deleted, issuing volume delete {{(pid=86148) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 06 15:29:39 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "cinder-quobyte-6fa14902-67ae-4f7e-909c-4713f4303b65" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:39 devstack sudo[92716]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.845s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:29:39 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-quobyte-6fa14902-67ae-4f7e-909c-4713f4303b65" acquired by "delete_volume" :: waited 0.022s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:39 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager._thread_info {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:29:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread count: 8 {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:29:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread info: [<_MainThread(MainThread, started 124857273856128)>, , , , , , , ] {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:29:39 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[25834711-2293-4c67-a81e-97cb3e677255]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:29:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:39 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a8a386ba-5077-43f1-927f-55fe5a1c19b3 tempest-VolumeQuotasAdminTestJSON-352800850 None] Acquiring lock "cinder-4d240a0f-a4af-48d9-ad03-139dfb5384c6-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:39 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a8a386ba-5077-43f1-927f-55fe5a1c19b3 tempest-VolumeQuotasAdminTestJSON-352800850 None] Lock "cinder-4d240a0f-a4af-48d9-ad03-139dfb5384c6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:39 devstack sudo[92723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65 Jul 06 15:29:39 devstack sudo[92723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:39 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a8a386ba-5077-43f1-927f-55fe5a1c19b3 tempest-VolumeQuotasAdminTestJSON-352800850 None] Acquiring lock "cinder-quobyte-4d240a0f-a4af-48d9-ad03-139dfb5384c6" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:39 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a8a386ba-5077-43f1-927f-55fe5a1c19b3 tempest-VolumeQuotasAdminTestJSON-352800850 None] Lock "cinder-quobyte-4d240a0f-a4af-48d9-ad03-139dfb5384c6" acquired by "delete_volume" :: waited 0.014s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:39 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea48755-ce47-45da-8961-31032d73d089]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:29:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a8a386ba-5077-43f1-927f-55fe5a1c19b3 tempest-VolumeQuotasAdminTestJSON-352800850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4d240a0f-a4af-48d9-ad03-139dfb5384c6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:39 devstack sudo[92725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4d240a0f-a4af-48d9-ad03-139dfb5384c6 Jul 06 15:29:39 devstack sudo[92725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:40 devstack sudo[92723]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65" returned: 0 in 0.876s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:40 devstack sudo[92732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65 Jul 06 15:29:40 devstack sudo[92732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:40 devstack sudo[92725]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a8a386ba-5077-43f1-927f-55fe5a1c19b3 tempest-VolumeQuotasAdminTestJSON-352800850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4d240a0f-a4af-48d9-ad03-139dfb5384c6" returned: 0 in 0.869s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a8a386ba-5077-43f1-927f-55fe5a1c19b3 tempest-VolumeQuotasAdminTestJSON-352800850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4d240a0f-a4af-48d9-ad03-139dfb5384c6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:40 devstack sudo[92741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4d240a0f-a4af-48d9-ad03-139dfb5384c6 Jul 06 15:29:40 devstack sudo[92741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:40 devstack sudo[92732]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6fa14902-67ae-4f7e-909c-4713f4303b65" returned: 0 in 0.666s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:40 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-quobyte-6fa14902-67ae-4f7e-909c-4713f4303b65" released by "delete_volume" :: held 1.649s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:40 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Created reservations ['15dc03fc-ca76-44a6-b55a-daaa397db20d', '9340f14e-9210-467e-94a9-e137139647cf', 'b76aca2c-13c0-486c-be06-ca495f47eafe', 'bf90fcdf-4b17-4d95-8196-c46f473453d6'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:29:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:41 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:29:41 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:29:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:41 devstack sudo[92747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:29:41 devstack sudo[92747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:41 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-1d4ad7b7-0297-40bc-b474-9885cf09709c req-9b70bb27-20f7-47a0-89a4-77044d5b0fc4 tempest-ServerActionsTestOtherA-2083244986 None] Terminate volume connection completed successfully. Jul 06 15:29:41 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-1d4ad7b7-0297-40bc-b474-9885cf09709c req-9b70bb27-20f7-47a0-89a4-77044d5b0fc4 tempest-ServerActionsTestOtherA-2083244986 None] Deleting attachment 05aafe60-96fd-40f6-8914-470ccbc3685d. {{(pid=86148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:29:41 devstack sudo[92741]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a8a386ba-5077-43f1-927f-55fe5a1c19b3 tempest-VolumeQuotasAdminTestJSON-352800850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4d240a0f-a4af-48d9-ad03-139dfb5384c6" returned: 0 in 0.738s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a8a386ba-5077-43f1-927f-55fe5a1c19b3 tempest-VolumeQuotasAdminTestJSON-352800850 None] Lock "cinder-quobyte-4d240a0f-a4af-48d9-ad03-139dfb5384c6" released by "delete_volume" :: held 1.661s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:41 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-a8a386ba-5077-43f1-927f-55fe5a1c19b3 tempest-VolumeQuotasAdminTestJSON-352800850 None] Created reservations ['067923bc-2515-4f62-a68e-aa334d36a3b0', '4de25355-3613-4fce-9b5f-3e29bf3200fd', '5d392d0c-dc43-4931-9660-a6d52dd9f824', '79d0ede1-6a73-41c3-956c-889a561e9f59'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:29:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a8a386ba-5077-43f1-927f-55fe5a1c19b3 tempest-VolumeQuotasAdminTestJSON-352800850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a8a386ba-5077-43f1-927f-55fe5a1c19b3 tempest-VolumeQuotasAdminTestJSON-352800850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:41 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a8a386ba-5077-43f1-927f-55fe5a1c19b3 tempest-VolumeQuotasAdminTestJSON-352800850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:29:41 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a8a386ba-5077-43f1-927f-55fe5a1c19b3 tempest-VolumeQuotasAdminTestJSON-352800850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:29:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a8a386ba-5077-43f1-927f-55fe5a1c19b3 tempest-VolumeQuotasAdminTestJSON-352800850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a8a386ba-5077-43f1-927f-55fe5a1c19b3 tempest-VolumeQuotasAdminTestJSON-352800850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:41 devstack sudo[92749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:29:41 devstack sudo[92749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:41 devstack sudo[92747]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.779s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:41 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:29:41 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Deleted volume successfully. Jul 06 15:29:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-262ad966-dec8-44f5-8d78-67de70200961 tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-6fa14902-67ae-4f7e-909c-4713f4303b65-delete_volume" released by "delete_volume" :: held 6.409s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:42 devstack sudo[92749]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a8a386ba-5077-43f1-927f-55fe5a1c19b3 tempest-VolumeQuotasAdminTestJSON-352800850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.757s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:42 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-a8a386ba-5077-43f1-927f-55fe5a1c19b3 tempest-VolumeQuotasAdminTestJSON-352800850 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:29:42 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a8a386ba-5077-43f1-927f-55fe5a1c19b3 tempest-VolumeQuotasAdminTestJSON-352800850 None] Deleted volume successfully. Jul 06 15:29:42 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a8a386ba-5077-43f1-927f-55fe5a1c19b3 tempest-VolumeQuotasAdminTestJSON-352800850 None] Lock "cinder-4d240a0f-a4af-48d9-ad03-139dfb5384c6-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:42 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a2745c09-ed93-4888-9a4b-79ecd997c7dd tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "cinder-debc111f-1a82-4926-9933-cfa1404af107-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:42 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a2745c09-ed93-4888-9a4b-79ecd997c7dd tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-debc111f-1a82-4926-9933-cfa1404af107-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:42 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a2745c09-ed93-4888-9a4b-79ecd997c7dd tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "cinder-quobyte-debc111f-1a82-4926-9933-cfa1404af107" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:42 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a2745c09-ed93-4888-9a4b-79ecd997c7dd tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-quobyte-debc111f-1a82-4926-9933-cfa1404af107" acquired by "delete_volume" :: waited 0.025s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:42 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5efaa54-4eff-4a49-949e-e056b4c7e366]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:29:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a2745c09-ed93-4888-9a4b-79ecd997c7dd tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-debc111f-1a82-4926-9933-cfa1404af107 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:42 devstack sudo[92754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-debc111f-1a82-4926-9933-cfa1404af107 Jul 06 15:29:42 devstack sudo[92754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:43 devstack sudo[92754]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a2745c09-ed93-4888-9a4b-79ecd997c7dd tempest-VolumesDeleteCascade-817725185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-debc111f-1a82-4926-9933-cfa1404af107" returned: 0 in 0.859s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a2745c09-ed93-4888-9a4b-79ecd997c7dd tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-debc111f-1a82-4926-9933-cfa1404af107 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:43 devstack sudo[92760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-debc111f-1a82-4926-9933-cfa1404af107 Jul 06 15:29:43 devstack sudo[92760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:43 devstack sudo[92760]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a2745c09-ed93-4888-9a4b-79ecd997c7dd tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-debc111f-1a82-4926-9933-cfa1404af107" returned: 0 in 0.731s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a2745c09-ed93-4888-9a4b-79ecd997c7dd tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-quobyte-debc111f-1a82-4926-9933-cfa1404af107" released by "delete_volume" :: held 1.636s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:43 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-a2745c09-ed93-4888-9a4b-79ecd997c7dd tempest-VolumesDeleteCascade-817725185 None] Created reservations ['50593f66-8bfb-4dbb-a904-6eeca7d548e3', '256fb52b-0ad5-4102-8360-fc99486c6e16', 'df68244a-5468-40b6-a7bf-10ad41f76705', '8a5e4039-8f1b-4c6a-92b6-00bac4c4e46f'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:29:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a2745c09-ed93-4888-9a4b-79ecd997c7dd tempest-VolumesDeleteCascade-817725185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a2745c09-ed93-4888-9a4b-79ecd997c7dd tempest-VolumesDeleteCascade-817725185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a2745c09-ed93-4888-9a4b-79ecd997c7dd tempest-VolumesDeleteCascade-817725185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:29:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a2745c09-ed93-4888-9a4b-79ecd997c7dd tempest-VolumesDeleteCascade-817725185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:29:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a2745c09-ed93-4888-9a4b-79ecd997c7dd tempest-VolumesDeleteCascade-817725185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a2745c09-ed93-4888-9a4b-79ecd997c7dd tempest-VolumesDeleteCascade-817725185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:44 devstack sudo[92764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:29:44 devstack sudo[92764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:44 devstack sudo[92764]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a2745c09-ed93-4888-9a4b-79ecd997c7dd tempest-VolumesDeleteCascade-817725185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.931s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:44 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-a2745c09-ed93-4888-9a4b-79ecd997c7dd tempest-VolumesDeleteCascade-817725185 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:29:44 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a2745c09-ed93-4888-9a4b-79ecd997c7dd tempest-VolumesDeleteCascade-817725185 None] Deleted volume successfully. Jul 06 15:29:45 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a2745c09-ed93-4888-9a4b-79ecd997c7dd tempest-VolumesDeleteCascade-817725185 None] Lock "cinder-debc111f-1a82-4926-9933-cfa1404af107-delete_volume" released by "delete_volume" :: held 2.820s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:51 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:29:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Flow 'volume_create_manager' (7ba3344c-4c76-415d-b363-e8ff705f5919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:29:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e83ec1-c619-4177-b290-fe45cea30a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e83ec1-c619-4177-b290-fe45cea30a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1121773105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0348d879-b059-46cf-9f30-6f082f9463ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da923c14c07944f49086ac91758033af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:29:52Z,use_quota=True,user_id='62ad12b0a0fd4fd2acc8e88039eec90a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc6276ff-2192-48fd-913e-ca2e3b083d47),volume_type_id=cc6276ff-2192-48fd-913e-ca2e3b083d47)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113e47e6-37f2-49d0-b737-53828f5ca149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113e47e6-37f2-49d0-b737-53828f5ca149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4cf5d89-83de-4b15-b42d-93e319392819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4cf5d89-83de-4b15-b42d-93e319392819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0348d879-b059-46cf-9f30-6f082f9463ec', 'volume_name': 'volume-0348d879-b059-46cf-9f30-6f082f9463ec', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0935b1-168a-43be-b10d-1c1ea2a49991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0935b1-168a-43be-b10d-1c1ea2a49991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b46ccd-ab4d-437f-a3af-32ede50ad67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:51 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Volume 0348d879-b059-46cf-9f30-6f082f9463ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0348d879-b059-46cf-9f30-6f082f9463ec', 'volume_size': 1} Jul 06 15:29:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1121773105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0348d879-b059-46cf-9f30-6f082f9463ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da923c14c07944f49086ac91758033af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:29:52Z,use_quota=True,user_id='62ad12b0a0fd4fd2acc8e88039eec90a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc6276ff-2192-48fd-913e-ca2e3b083d47),volume_type_id=cc6276ff-2192-48fd-913e-ca2e3b083d47)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:29:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Creating volume 0348d879-b059-46cf-9f30-6f082f9463ec {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:29:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:29:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:29:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:29:51 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:29:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0348d879-b059-46cf-9f30-6f082f9463ec 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:51 devstack sudo[92907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0348d879-b059-46cf-9f30-6f082f9463ec 1073741824 Jul 06 15:29:51 devstack sudo[92907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:53 devstack sudo[92907]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0348d879-b059-46cf-9f30-6f082f9463ec 1073741824" returned: 0 in 1.402s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0348d879-b059-46cf-9f30-6f082f9463ec {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:53 devstack sudo[92912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0348d879-b059-46cf-9f30-6f082f9463ec Jul 06 15:29:53 devstack sudo[92912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f1380f12-8867-4519-bbbe-b00ca21757a1 tempest-ServerActionsTestOtherA-2083244986 None] Acquiring lock "cinder-0c457ae1-17fe-49f5-ba43-deeeb54f9553-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f1380f12-8867-4519-bbbe-b00ca21757a1 tempest-ServerActionsTestOtherA-2083244986 None] Lock "cinder-0c457ae1-17fe-49f5-ba43-deeeb54f9553-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f1380f12-8867-4519-bbbe-b00ca21757a1 tempest-ServerActionsTestOtherA-2083244986 None] Acquiring lock "cinder-quobyte-0c457ae1-17fe-49f5-ba43-deeeb54f9553" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f1380f12-8867-4519-bbbe-b00ca21757a1 tempest-ServerActionsTestOtherA-2083244986 None] Lock "cinder-quobyte-0c457ae1-17fe-49f5-ba43-deeeb54f9553" acquired by "delete_volume" :: waited 0.024s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:54 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1c389e-6be2-4100-a9d0-8add9c81ad56]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:29:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f1380f12-8867-4519-bbbe-b00ca21757a1 tempest-ServerActionsTestOtherA-2083244986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0c457ae1-17fe-49f5-ba43-deeeb54f9553 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:54 devstack sudo[92912]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0348d879-b059-46cf-9f30-6f082f9463ec" returned: 0 in 1.160s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] <== create_volume: return (2625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:29:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.629s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b46ccd-ab4d-437f-a3af-32ede50ad67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0348d879-b059-46cf-9f30-6f082f9463ec', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d626d18c-cb1c-45e5-956b-b90f1333d4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:54 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Volume volume-0348d879-b059-46cf-9f30-6f082f9463ec (0348d879-b059-46cf-9f30-6f082f9463ec): created successfully Jul 06 15:29:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d626d18c-cb1c-45e5-956b-b90f1333d4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Flow 'volume_create_manager' (7ba3344c-4c76-415d-b363-e8ff705f5919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:29:54 devstack sudo[92915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0c457ae1-17fe-49f5-ba43-deeeb54f9553 Jul 06 15:29:54 devstack sudo[92915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:54 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-d8255a2a-7435-4631-864b-0d79c2a6fda1 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Created volume successfully. Jul 06 15:29:55 devstack sudo[92915]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f1380f12-8867-4519-bbbe-b00ca21757a1 tempest-ServerActionsTestOtherA-2083244986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0c457ae1-17fe-49f5-ba43-deeeb54f9553" returned: 0 in 0.915s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f1380f12-8867-4519-bbbe-b00ca21757a1 tempest-ServerActionsTestOtherA-2083244986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0c457ae1-17fe-49f5-ba43-deeeb54f9553 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:55 devstack sudo[92921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0c457ae1-17fe-49f5-ba43-deeeb54f9553 Jul 06 15:29:55 devstack sudo[92921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1399c720-33d5-4e52-8b68-5ae59d4b1a99 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1399c720-33d5-4e52-8b68-5ae59d4b1a99 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:55 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1399c720-33d5-4e52-8b68-5ae59d4b1a99 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:29:55 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1399c720-33d5-4e52-8b68-5ae59d4b1a99 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:29:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1399c720-33d5-4e52-8b68-5ae59d4b1a99 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1399c720-33d5-4e52-8b68-5ae59d4b1a99 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:55 devstack sudo[92923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:29:55 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:56 devstack sudo[92921]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f1380f12-8867-4519-bbbe-b00ca21757a1 tempest-ServerActionsTestOtherA-2083244986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0c457ae1-17fe-49f5-ba43-deeeb54f9553" returned: 0 in 1.241s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f1380f12-8867-4519-bbbe-b00ca21757a1 tempest-ServerActionsTestOtherA-2083244986 None] Lock "cinder-quobyte-0c457ae1-17fe-49f5-ba43-deeeb54f9553" released by "delete_volume" :: held 2.234s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:56 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:56 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-f1380f12-8867-4519-bbbe-b00ca21757a1 tempest-ServerActionsTestOtherA-2083244986 None] Created reservations ['7ec0301e-0a0d-445a-956b-6856606b4542', 'e11bdceb-c502-42e0-94bb-7ab62309f8eb', '8d9215d0-2ff9-407f-ad15-7f202a308760', '17a9571e-4b45-45a7-83b0-f5e1f14bac84'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:29:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1399c720-33d5-4e52-8b68-5ae59d4b1a99 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.241s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:56 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-1399c720-33d5-4e52-8b68-5ae59d4b1a99 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:29:56 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-1399c720-33d5-4e52-8b68-5ae59d4b1a99 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Retype volume completed successfully. Jul 06 15:29:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f1380f12-8867-4519-bbbe-b00ca21757a1 tempest-ServerActionsTestOtherA-2083244986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f1380f12-8867-4519-bbbe-b00ca21757a1 tempest-ServerActionsTestOtherA-2083244986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f1380f12-8867-4519-bbbe-b00ca21757a1 tempest-ServerActionsTestOtherA-2083244986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:29:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f1380f12-8867-4519-bbbe-b00ca21757a1 tempest-ServerActionsTestOtherA-2083244986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:29:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f1380f12-8867-4519-bbbe-b00ca21757a1 tempest-ServerActionsTestOtherA-2083244986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f1380f12-8867-4519-bbbe-b00ca21757a1 tempest-ServerActionsTestOtherA-2083244986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:56 devstack sudo[92927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:29:56 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:57 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c72addef-b767-4acf-a456-55de9aee7473 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Acquiring lock "cinder-0348d879-b059-46cf-9f30-6f082f9463ec-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:57 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c72addef-b767-4acf-a456-55de9aee7473 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Lock "cinder-0348d879-b059-46cf-9f30-6f082f9463ec-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:57 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c72addef-b767-4acf-a456-55de9aee7473 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Acquiring lock "cinder-quobyte-0348d879-b059-46cf-9f30-6f082f9463ec" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:57 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c72addef-b767-4acf-a456-55de9aee7473 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Lock "cinder-quobyte-0348d879-b059-46cf-9f30-6f082f9463ec" acquired by "delete_volume" :: waited 0.032s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:57 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d0dbad-0d48-46f9-85d5-6a2f4f63f59e]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:29:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c72addef-b767-4acf-a456-55de9aee7473 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0348d879-b059-46cf-9f30-6f082f9463ec {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:57 devstack sudo[92929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0348d879-b059-46cf-9f30-6f082f9463ec Jul 06 15:29:57 devstack sudo[92929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:57 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f1380f12-8867-4519-bbbe-b00ca21757a1 tempest-ServerActionsTestOtherA-2083244986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.823s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:57 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-f1380f12-8867-4519-bbbe-b00ca21757a1 tempest-ServerActionsTestOtherA-2083244986 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:29:57 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-f1380f12-8867-4519-bbbe-b00ca21757a1 tempest-ServerActionsTestOtherA-2083244986 None] Deleted volume successfully. Jul 06 15:29:57 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f1380f12-8867-4519-bbbe-b00ca21757a1 tempest-ServerActionsTestOtherA-2083244986 None] Lock "cinder-0c457ae1-17fe-49f5-ba43-deeeb54f9553-delete_volume" released by "delete_volume" :: held 3.453s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:58 devstack sudo[92929]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c72addef-b767-4acf-a456-55de9aee7473 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0348d879-b059-46cf-9f30-6f082f9463ec" returned: 0 in 1.106s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c72addef-b767-4acf-a456-55de9aee7473 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0348d879-b059-46cf-9f30-6f082f9463ec {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:58 devstack sudo[92937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0348d879-b059-46cf-9f30-6f082f9463ec Jul 06 15:29:58 devstack sudo[92937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:59 devstack sudo[92937]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c72addef-b767-4acf-a456-55de9aee7473 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0348d879-b059-46cf-9f30-6f082f9463ec" returned: 0 in 0.794s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c72addef-b767-4acf-a456-55de9aee7473 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Lock "cinder-quobyte-0348d879-b059-46cf-9f30-6f082f9463ec" released by "delete_volume" :: held 1.975s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:59 devstack cinder-volume[86148]: WARNING cinder.quota [None req-c72addef-b767-4acf-a456-55de9aee7473 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:29:59 devstack cinder-volume[86148]: WARNING cinder.quota [None req-c72addef-b767-4acf-a456-55de9aee7473 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:29:59 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-c72addef-b767-4acf-a456-55de9aee7473 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Created reservations ['761248c4-0677-432e-a8eb-ad36adf28b89', '5cf12945-152c-4d76-a969-facbaf1543b4', '506024b1-9d31-4be7-9375-df9c750e940a', 'b9ccea9f-d873-4937-9fde-6f8a0c18338e'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:29:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c72addef-b767-4acf-a456-55de9aee7473 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c72addef-b767-4acf-a456-55de9aee7473 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:59 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c72addef-b767-4acf-a456-55de9aee7473 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:29:59 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c72addef-b767-4acf-a456-55de9aee7473 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:29:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c72addef-b767-4acf-a456-55de9aee7473 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c72addef-b767-4acf-a456-55de9aee7473 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:59 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:29:59 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:00 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c72addef-b767-4acf-a456-55de9aee7473 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.114s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:00 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-c72addef-b767-4acf-a456-55de9aee7473 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:30:00 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-c72addef-b767-4acf-a456-55de9aee7473 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Deleted volume successfully. Jul 06 15:30:00 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c72addef-b767-4acf-a456-55de9aee7473 tempest-VolumeRetypeWithoutMigrationTest-1994280993 None] Lock "cinder-0348d879-b059-46cf-9f30-6f082f9463ec-delete_volume" released by "delete_volume" :: held 3.449s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:30:04 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:30:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Flow 'volume_create_manager' (49c32439-3ac7-489d-b8a0-6c9677ad65c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:30:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (096a6209-fc1f-45cd-a7aa-31d34c28d81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (096a6209-fc1f-45cd-a7aa-31d34c28d81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-490405438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ca9d4b-062e-4c5f-9937-ea60c9dac5d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed7d8d3ff193422a8ff439a16b6a866a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:05Z,use_quota=True,user_id='de0835629c62432ca0bc96bb917b1671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66626ef1-9d38-4dda-b233-9d5c99cf7bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66626ef1-9d38-4dda-b233-9d5c99cf7bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afb658a3-553d-4111-8873-ec4846ac3a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afb658a3-553d-4111-8873-ec4846ac3a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31ca9d4b-062e-4c5f-9937-ea60c9dac5d9', 'volume_name': 'volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b259f1df-a6e5-4ea6-a056-12d8f0efca07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b259f1df-a6e5-4ea6-a056-12d8f0efca07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb5396e8-f300-427c-bf16-6fba23c538bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:04 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Volume 31ca9d4b-062e-4c5f-9937-ea60c9dac5d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9', 'volume_size': 1} Jul 06 15:30:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:04 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-490405438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ca9d4b-062e-4c5f-9937-ea60c9dac5d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed7d8d3ff193422a8ff439a16b6a866a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:05Z,use_quota=True,user_id='de0835629c62432ca0bc96bb917b1671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:30:04 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Creating volume 31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:30:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:04 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:30:04 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:30:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:04 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:30:04 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:30:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:04 devstack sudo[92973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 1073741824 Jul 06 15:30:04 devstack sudo[92973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:05 devstack sudo[92973]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 1073741824" returned: 0 in 0.840s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:05 devstack sudo[92979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 Jul 06 15:30:05 devstack sudo[92979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:06 devstack sudo[92979]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9" returned: 0 in 0.689s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:06 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:30:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb5396e8-f300-427c-bf16-6fba23c538bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345001ba-31d7-4623-8b5b-b7562c13bdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:06 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Volume volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 (31ca9d4b-062e-4c5f-9937-ea60c9dac5d9): created successfully Jul 06 15:30:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345001ba-31d7-4623-8b5b-b7562c13bdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Flow 'volume_create_manager' (49c32439-3ac7-489d-b8a0-6c9677ad65c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:30:06 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-ea0da932-42d4-482f-b707-42200b8344b9 tempest-VolumesActionsTest-611226632 None] Created volume successfully. Jul 06 15:30:08 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:30:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Flow 'volume_create_manager' (10c93b93-92af-468d-af4b-508bfa672ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:30:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9437d0f-0069-4061-b68f-ff2a482961a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9437d0f-0069-4061-b68f-ff2a482961a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-14878853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddef344c-9865-432a-a9e8-a5dfca3290d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e89120e8ee841c3abca7cb07705df5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:08Z,use_quota=True,user_id='74ac5fb95c2d41a7a7db6a445a9ee538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd657ce3-5938-41e5-90f9-5838cc664e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd657ce3-5938-41e5-90f9-5838cc664e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63056a5-00a7-4596-95bc-00a440125f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63056a5-00a7-4596-95bc-00a440125f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddef344c-9865-432a-a9e8-a5dfca3290d5', 'volume_name': 'volume-ddef344c-9865-432a-a9e8-a5dfca3290d5', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64383a9-0612-478a-bf96-7d593ee8485f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64383a9-0612-478a-bf96-7d593ee8485f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c574004-f724-4b6d-8e23-de0ec3287124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:08 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Volume ddef344c-9865-432a-a9e8-a5dfca3290d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddef344c-9865-432a-a9e8-a5dfca3290d5', 'volume_size': 1} Jul 06 15:30:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-14878853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddef344c-9865-432a-a9e8-a5dfca3290d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e89120e8ee841c3abca7cb07705df5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:08Z,use_quota=True,user_id='74ac5fb95c2d41a7a7db6a445a9ee538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:30:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Creating volume ddef344c-9865-432a-a9e8-a5dfca3290d5 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:30:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:30:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:30:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:30:08 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:30:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ddef344c-9865-432a-a9e8-a5dfca3290d5 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:08 devstack sudo[92987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ddef344c-9865-432a-a9e8-a5dfca3290d5 1073741824 Jul 06 15:30:08 devstack sudo[92987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:09 devstack sudo[92987]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ddef344c-9865-432a-a9e8-a5dfca3290d5 1073741824" returned: 0 in 0.961s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ddef344c-9865-432a-a9e8-a5dfca3290d5 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:09 devstack sudo[92996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ddef344c-9865-432a-a9e8-a5dfca3290d5 Jul 06 15:30:09 devstack sudo[92996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:10 devstack sudo[92996]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ddef344c-9865-432a-a9e8-a5dfca3290d5" returned: 0 in 0.777s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:10 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:30:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c574004-f724-4b6d-8e23-de0ec3287124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddef344c-9865-432a-a9e8-a5dfca3290d5', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a3b8e0-20a1-442a-8c03-f29ab1429174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:10 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Volume volume-ddef344c-9865-432a-a9e8-a5dfca3290d5 (ddef344c-9865-432a-a9e8-a5dfca3290d5): created successfully Jul 06 15:30:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a3b8e0-20a1-442a-8c03-f29ab1429174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Flow 'volume_create_manager' (10c93b93-92af-468d-af4b-508bfa672ece) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:30:10 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-75c6a756-18a2-4595-b153-fa96e5352d23 tempest-VolumesServicesTestJSON-473605902 None] Created volume successfully. Jul 06 15:30:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-33915433-cb47-4357-bf7b-c87eed60643c tempest-VolumesServicesTestJSON-473605902 None] Acquiring lock "cinder-ddef344c-9865-432a-a9e8-a5dfca3290d5-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:30:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-33915433-cb47-4357-bf7b-c87eed60643c tempest-VolumesServicesTestJSON-473605902 None] Lock "cinder-ddef344c-9865-432a-a9e8-a5dfca3290d5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:30:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-33915433-cb47-4357-bf7b-c87eed60643c tempest-VolumesServicesTestJSON-473605902 None] Acquiring lock "cinder-quobyte-ddef344c-9865-432a-a9e8-a5dfca3290d5" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:30:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-33915433-cb47-4357-bf7b-c87eed60643c tempest-VolumesServicesTestJSON-473605902 None] Lock "cinder-quobyte-ddef344c-9865-432a-a9e8-a5dfca3290d5" acquired by "delete_volume" :: waited 0.017s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:30:10 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1f3d00-1a0a-4132-b206-d84bbf1ec001]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:30:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-33915433-cb47-4357-bf7b-c87eed60643c tempest-VolumesServicesTestJSON-473605902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ddef344c-9865-432a-a9e8-a5dfca3290d5 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:10 devstack sudo[93000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ddef344c-9865-432a-a9e8-a5dfca3290d5 Jul 06 15:30:10 devstack sudo[93000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:11 devstack sudo[93000]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-33915433-cb47-4357-bf7b-c87eed60643c tempest-VolumesServicesTestJSON-473605902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ddef344c-9865-432a-a9e8-a5dfca3290d5" returned: 0 in 0.839s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-33915433-cb47-4357-bf7b-c87eed60643c tempest-VolumesServicesTestJSON-473605902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ddef344c-9865-432a-a9e8-a5dfca3290d5 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:11 devstack sudo[93005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ddef344c-9865-432a-a9e8-a5dfca3290d5 Jul 06 15:30:11 devstack sudo[93005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:12 devstack sudo[93005]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-33915433-cb47-4357-bf7b-c87eed60643c tempest-VolumesServicesTestJSON-473605902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ddef344c-9865-432a-a9e8-a5dfca3290d5" returned: 0 in 0.725s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:12 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-33915433-cb47-4357-bf7b-c87eed60643c tempest-VolumesServicesTestJSON-473605902 None] Lock "cinder-quobyte-ddef344c-9865-432a-a9e8-a5dfca3290d5" released by "delete_volume" :: held 1.633s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:30:12 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-33915433-cb47-4357-bf7b-c87eed60643c tempest-VolumesServicesTestJSON-473605902 None] Created reservations ['f7148ca0-8150-46c1-b5af-7e2af614238d', 'c1947f82-3873-44b6-a3bd-59e415af5cfa', '2e37c5e4-060f-4635-8097-90a84b64474f', '934b1f50-e9ee-4fbc-a102-5409794de27c'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:30:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-33915433-cb47-4357-bf7b-c87eed60643c tempest-VolumesServicesTestJSON-473605902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-33915433-cb47-4357-bf7b-c87eed60643c tempest-VolumesServicesTestJSON-473605902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-33915433-cb47-4357-bf7b-c87eed60643c tempest-VolumesServicesTestJSON-473605902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:30:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-33915433-cb47-4357-bf7b-c87eed60643c tempest-VolumesServicesTestJSON-473605902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:30:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-33915433-cb47-4357-bf7b-c87eed60643c tempest-VolumesServicesTestJSON-473605902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-33915433-cb47-4357-bf7b-c87eed60643c tempest-VolumesServicesTestJSON-473605902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:12 devstack sudo[93008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:30:12 devstack sudo[93008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:13 devstack sudo[93008]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-33915433-cb47-4357-bf7b-c87eed60643c tempest-VolumesServicesTestJSON-473605902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.800s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:13 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-33915433-cb47-4357-bf7b-c87eed60643c tempest-VolumesServicesTestJSON-473605902 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:30:13 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-33915433-cb47-4357-bf7b-c87eed60643c tempest-VolumesServicesTestJSON-473605902 None] Deleted volume successfully. Jul 06 15:30:13 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-33915433-cb47-4357-bf7b-c87eed60643c tempest-VolumesServicesTestJSON-473605902 None] Lock "cinder-ddef344c-9865-432a-a9e8-a5dfca3290d5-delete_volume" released by "delete_volume" :: held 2.706s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:30:20 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:30:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Flow 'volume_create_manager' (680df5b3-99c2-4f6f-99ac-c413c92af9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:30:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4773d6-2807-4e3a-b399-dd5d0af602d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4773d6-2807-4e3a-b399-dd5d0af602d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1518242167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f641020f-ee5e-4b59-8927-5812f7030273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc4336a5fba64362a0f20c9e0e7e832f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:21Z,use_quota=True,user_id='fd52e63e210749729ddcb31659864920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ffe6dc8-aace-4a97-8e92-009b58fe9a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ffe6dc8-aace-4a97-8e92-009b58fe9a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a056f19e-ab55-449b-bdfe-12dbf00d7963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a056f19e-ab55-449b-bdfe-12dbf00d7963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f641020f-ee5e-4b59-8927-5812f7030273', 'volume_name': 'volume-f641020f-ee5e-4b59-8927-5812f7030273', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f173587-7213-4d10-ba99-645ad9fc60df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f173587-7213-4d10-ba99-645ad9fc60df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee82a03-93fb-41e4-a5d5-37cd6a69bb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:20 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Volume f641020f-ee5e-4b59-8927-5812f7030273: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f641020f-ee5e-4b59-8927-5812f7030273', 'volume_size': 1} Jul 06 15:30:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1518242167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f641020f-ee5e-4b59-8927-5812f7030273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc4336a5fba64362a0f20c9e0e7e832f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:21Z,use_quota=True,user_id='fd52e63e210749729ddcb31659864920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:30:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Creating volume f641020f-ee5e-4b59-8927-5812f7030273 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:30:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:30:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:30:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:30:20 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:30:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:20 devstack sudo[93099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273 1073741824 Jul 06 15:30:20 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:21 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273 1073741824" returned: 0 in 0.992s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:21 devstack sudo[93116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273 Jul 06 15:30:21 devstack sudo[93116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:22 devstack sudo[93116]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273" returned: 0 in 0.802s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:22 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] <== create_volume: return (1841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:30:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee82a03-93fb-41e4-a5d5-37cd6a69bb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f641020f-ee5e-4b59-8927-5812f7030273', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b28782-ec50-420f-b919-13468d172a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:22 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Volume volume-f641020f-ee5e-4b59-8927-5812f7030273 (f641020f-ee5e-4b59-8927-5812f7030273): created successfully Jul 06 15:30:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b28782-ec50-420f-b919-13468d172a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Flow 'volume_create_manager' (680df5b3-99c2-4f6f-99ac-c413c92af9b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:30:22 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-836322c6-4394-4160-bf31-783aa2bc51d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Created volume successfully. Jul 06 15:30:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b8975144-78e3-4934-acd7-a9d39dfe5692 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b8975144-78e3-4934-acd7-a9d39dfe5692 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-b8975144-78e3-4934-acd7-a9d39dfe5692 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Creating offline snapshot 9424ebb9-0236-4181-bf46-b8ae6dc7a613 of volume f641020f-ee5e-4b59-8927-5812f7030273 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:30:24 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[e793c9e1-1755-4825-90ac-29ce3fb16f21]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:30:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b8975144-78e3-4934-acd7-a9d39dfe5692 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:24 devstack sudo[93134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273 Jul 06 15:30:24 devstack sudo[93134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:25 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-3438a567-40cb-4ac3-8565-7293c0394dee tempest-VolumesActionsTest-611226632 None] Acquiring lock "cinder-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9" by "attach_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:30:25 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-3438a567-40cb-4ac3-8565-7293c0394dee tempest-VolumesActionsTest-611226632 None] Lock "cinder-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9" acquired by "attach_volume" :: waited 0.038s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:30:25 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-3438a567-40cb-4ac3-8565-7293c0394dee tempest-VolumesActionsTest-611226632 None] Attaching volume 31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 to instance 2000a5ab-a0de-4051-838d-a152fa08a4d3 at mountpoint /dev/vdb on host None. Jul 06 15:30:25 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-3438a567-40cb-4ac3-8565-7293c0394dee tempest-VolumesActionsTest-611226632 None] Attach volume completed successfully. Jul 06 15:30:25 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-3438a567-40cb-4ac3-8565-7293c0394dee tempest-VolumesActionsTest-611226632 None] Lock "cinder-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9" released by "attach_volume" :: held 0.264s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:30:25 devstack sudo[93134]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b8975144-78e3-4934-acd7-a9d39dfe5692 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273" returned: 0 in 1.444s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b8975144-78e3-4934-acd7-a9d39dfe5692 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273.9424ebb9-0236-4181-bf46-b8ae6dc7a613 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:25 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273.9424ebb9-0236-4181-bf46-b8ae6dc7a613 1G Jul 06 15:30:25 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:25 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2f50c760-9eef-43f4-899d-1eabdf50f336 tempest-VolumesActionsTest-611226632 None] Acquiring lock "cinder-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9-detach_volume" by "detach_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:30:25 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2f50c760-9eef-43f4-899d-1eabdf50f336 tempest-VolumesActionsTest-611226632 None] Lock "cinder-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:30:25 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-2f50c760-9eef-43f4-899d-1eabdf50f336 tempest-VolumesActionsTest-611226632 None] Detaching volume 31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 from instance 2000a5ab-a0de-4051-838d-a152fa08a4d3. Jul 06 15:30:26 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-2f50c760-9eef-43f4-899d-1eabdf50f336 tempest-VolumesActionsTest-611226632 None] Detach volume completed successfully. Jul 06 15:30:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2f50c760-9eef-43f4-899d-1eabdf50f336 tempest-VolumesActionsTest-611226632 None] Lock "cinder-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9-detach_volume" released by "detach_volume" :: held 0.218s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:30:27 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b8975144-78e3-4934-acd7-a9d39dfe5692 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273.9424ebb9-0236-4181-bf46-b8ae6dc7a613 1G" returned: 0 in 1.558s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b8975144-78e3-4934-acd7-a9d39dfe5692 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f641020f-ee5e-4b59-8927-5812f7030273 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273.9424ebb9-0236-4181-bf46-b8ae6dc7a613 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:27 devstack sudo[93146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f641020f-ee5e-4b59-8927-5812f7030273 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273.9424ebb9-0236-4181-bf46-b8ae6dc7a613 Jul 06 15:30:27 devstack sudo[93146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:28 devstack sudo[93146]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b8975144-78e3-4934-acd7-a9d39dfe5692 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f641020f-ee5e-4b59-8927-5812f7030273 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273.9424ebb9-0236-4181-bf46-b8ae6dc7a613" returned: 0 in 1.050s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:28 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-b8975144-78e3-4934-acd7-a9d39dfe5692 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273.9424ebb9-0236-4181-bf46-b8ae6dc7a613 is being set with open permissions: ugo+rw Jul 06 15:30:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b8975144-78e3-4934-acd7-a9d39dfe5692 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273.9424ebb9-0236-4181-bf46-b8ae6dc7a613 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:28 devstack sudo[93158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273.9424ebb9-0236-4181-bf46-b8ae6dc7a613 Jul 06 15:30:28 devstack sudo[93158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:29 devstack sudo[93158]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b8975144-78e3-4934-acd7-a9d39dfe5692 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273.9424ebb9-0236-4181-bf46-b8ae6dc7a613" returned: 0 in 0.888s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:29 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:UPDATE=86,cinder:SELECT=62,cinder:DELETE=7,cinder:INSERT=16 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:30:29 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=72,cinder:INSERT=23,cinder:UPDATE=85,cinder:DELETE=6 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:30:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b8975144-78e3-4934-acd7-a9d39dfe5692 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:29 devstack sudo[93176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273.info Jul 06 15:30:29 devstack sudo[93176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:30 devstack sudo[93176]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b8975144-78e3-4934-acd7-a9d39dfe5692 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273.info" returned: 0 in 0.866s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:30 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-b8975144-78e3-4934-acd7-a9d39dfe5692 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273.info is being set with open permissions: ugo+rw Jul 06 15:30:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b8975144-78e3-4934-acd7-a9d39dfe5692 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:30 devstack sudo[93180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273.info Jul 06 15:30:30 devstack sudo[93180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:30 devstack sudo[93180]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b8975144-78e3-4934-acd7-a9d39dfe5692 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273.info" returned: 0 in 0.835s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b8975144-78e3-4934-acd7-a9d39dfe5692 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.800s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:31 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-b8975144-78e3-4934-acd7-a9d39dfe5692 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Create snapshot completed successfully Jul 06 15:30:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-55fdcb92-8fdb-4732-b0d6-e49315e28da3 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Acquiring lock "cinder-9424ebb9-0236-4181-bf46-b8ae6dc7a613-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:30:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-55fdcb92-8fdb-4732-b0d6-e49315e28da3 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Lock "cinder-9424ebb9-0236-4181-bf46-b8ae6dc7a613-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:30:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-55fdcb92-8fdb-4732-b0d6-e49315e28da3 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Acquiring lock "cinder-quobyte-f641020f-ee5e-4b59-8927-5812f7030273" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:30:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-55fdcb92-8fdb-4732-b0d6-e49315e28da3 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Lock "cinder-quobyte-f641020f-ee5e-4b59-8927-5812f7030273" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:30:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-55fdcb92-8fdb-4732-b0d6-e49315e28da3 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Acquiring lock "cinder-quobyte-9424ebb9-0236-4181-bf46-b8ae6dc7a613" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:30:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-55fdcb92-8fdb-4732-b0d6-e49315e28da3 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Lock "cinder-quobyte-9424ebb9-0236-4181-bf46-b8ae6dc7a613" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:30:32 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-55fdcb92-8fdb-4732-b0d6-e49315e28da3 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Deleting offline snapshot 9424ebb9-0236-4181-bf46-b8ae6dc7a613 of volume f641020f-ee5e-4b59-8927-5812f7030273 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:30:32 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-55fdcb92-8fdb-4732-b0d6-e49315e28da3 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] snapshot_file for this snap is: volume-f641020f-ee5e-4b59-8927-5812f7030273.9424ebb9-0236-4181-bf46-b8ae6dc7a613 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:30:32 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[779ce0d0-4e27-496a-92d7-987ccf67a4f0]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:30:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-55fdcb92-8fdb-4732-b0d6-e49315e28da3 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273.9424ebb9-0236-4181-bf46-b8ae6dc7a613 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:32 devstack sudo[93190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273.9424ebb9-0236-4181-bf46-b8ae6dc7a613 Jul 06 15:30:32 devstack sudo[93190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:33 devstack sudo[93190]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-55fdcb92-8fdb-4732-b0d6-e49315e28da3 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273.9424ebb9-0236-4181-bf46-b8ae6dc7a613" returned: 0 in 0.863s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-55fdcb92-8fdb-4732-b0d6-e49315e28da3 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f641020f-ee5e-4b59-8927-5812f7030273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:30:33 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6a81d5-a5a2-4650-bb80-c1a77c79ac33]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:30:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-55fdcb92-8fdb-4732-b0d6-e49315e28da3 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:33 devstack sudo[93230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273 Jul 06 15:30:33 devstack sudo[93230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:34 devstack sudo[93230]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-55fdcb92-8fdb-4732-b0d6-e49315e28da3 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273" returned: 0 in 0.984s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-55fdcb92-8fdb-4732-b0d6-e49315e28da3 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273.9424ebb9-0236-4181-bf46-b8ae6dc7a613 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:34 devstack sudo[93238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273.9424ebb9-0236-4181-bf46-b8ae6dc7a613 Jul 06 15:30:34 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:35 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-55fdcb92-8fdb-4732-b0d6-e49315e28da3 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273.9424ebb9-0236-4181-bf46-b8ae6dc7a613" returned: 0 in 0.786s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-55fdcb92-8fdb-4732-b0d6-e49315e28da3 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273.9424ebb9-0236-4181-bf46-b8ae6dc7a613 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:35 devstack sudo[93245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273.9424ebb9-0236-4181-bf46-b8ae6dc7a613 Jul 06 15:30:35 devstack sudo[93245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:35 devstack sudo[93245]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-55fdcb92-8fdb-4732-b0d6-e49315e28da3 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273.9424ebb9-0236-4181-bf46-b8ae6dc7a613" returned: 0 in 0.717s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-55fdcb92-8fdb-4732-b0d6-e49315e28da3 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Lock "cinder-quobyte-9424ebb9-0236-4181-bf46-b8ae6dc7a613" released by "_delete_snapshot" :: held 3.531s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:30:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-55fdcb92-8fdb-4732-b0d6-e49315e28da3 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Lock "cinder-quobyte-f641020f-ee5e-4b59-8927-5812f7030273" released by "delete_snapshot" :: held 3.564s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:30:35 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-55fdcb92-8fdb-4732-b0d6-e49315e28da3 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Created reservations ['93d3b0b3-6db5-4131-899b-c66272b37bc3', '946094d8-898b-416b-b2e9-de22efff191f', '36988d9e-5220-49a2-8e96-6305e2e85f7e', 'ee23e1ae-b1cb-4558-8527-2cbb0f010971'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:30:35 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-55fdcb92-8fdb-4732-b0d6-e49315e28da3 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Delete snapshot completed successfully. Jul 06 15:30:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-55fdcb92-8fdb-4732-b0d6-e49315e28da3 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Lock "cinder-9424ebb9-0236-4181-bf46-b8ae6dc7a613-delete_snapshot" released by "delete_snapshot" :: held 3.741s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:30:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f2acf9fa-26a5-4400-8f0c-a561d5bd9cd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Acquiring lock "cinder-f641020f-ee5e-4b59-8927-5812f7030273-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:30:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f2acf9fa-26a5-4400-8f0c-a561d5bd9cd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Lock "cinder-f641020f-ee5e-4b59-8927-5812f7030273-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:30:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f2acf9fa-26a5-4400-8f0c-a561d5bd9cd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Acquiring lock "cinder-quobyte-f641020f-ee5e-4b59-8927-5812f7030273" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:30:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f2acf9fa-26a5-4400-8f0c-a561d5bd9cd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Lock "cinder-quobyte-f641020f-ee5e-4b59-8927-5812f7030273" acquired by "delete_volume" :: waited 0.020s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:30:36 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5ad2ad-3f5e-46a2-9ace-661ea5e62746]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:30:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f2acf9fa-26a5-4400-8f0c-a561d5bd9cd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:36 devstack sudo[93253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273 Jul 06 15:30:36 devstack sudo[93253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:37 devstack sudo[93253]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f2acf9fa-26a5-4400-8f0c-a561d5bd9cd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273" returned: 0 in 0.855s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f2acf9fa-26a5-4400-8f0c-a561d5bd9cd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:37 devstack sudo[93259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273 Jul 06 15:30:37 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:30:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:30:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:30:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:38 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:30:38 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:38 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f2acf9fa-26a5-4400-8f0c-a561d5bd9cd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f641020f-ee5e-4b59-8927-5812f7030273" returned: 0 in 0.919s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f2acf9fa-26a5-4400-8f0c-a561d5bd9cd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Lock "cinder-quobyte-f641020f-ee5e-4b59-8927-5812f7030273" released by "delete_volume" :: held 1.854s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:30:38 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-f2acf9fa-26a5-4400-8f0c-a561d5bd9cd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Created reservations ['d3e4f60a-f551-4928-b981-3b0e580c1cd9', 'e488ec10-775e-491d-ad5e-2d350c53fb83', '53b86761-86ae-47b9-bef1-cbd824bb91da', '49e72769-ac9f-4f4e-8bf8-226acfa08634'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:30:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f2acf9fa-26a5-4400-8f0c-a561d5bd9cd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f2acf9fa-26a5-4400-8f0c-a561d5bd9cd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f2acf9fa-26a5-4400-8f0c-a561d5bd9cd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:30:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f2acf9fa-26a5-4400-8f0c-a561d5bd9cd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:30:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f2acf9fa-26a5-4400-8f0c-a561d5bd9cd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f2acf9fa-26a5-4400-8f0c-a561d5bd9cd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:38 devstack sudo[93284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:30:38 devstack sudo[93284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:39 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.161s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:30:39 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager._thread_info {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:30:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread count: 8 {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:30:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread info: [<_MainThread(MainThread, started 124857273856128)>, , , , , , , ] {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:30:39 devstack sudo[93284]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f2acf9fa-26a5-4400-8f0c-a561d5bd9cd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.181s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-f2acf9fa-26a5-4400-8f0c-a561d5bd9cd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:30:39 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-f2acf9fa-26a5-4400-8f0c-a561d5bd9cd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Deleted volume successfully. Jul 06 15:30:39 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f2acf9fa-26a5-4400-8f0c-a561d5bd9cd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-818926694 None] Lock "cinder-f641020f-ee5e-4b59-8927-5812f7030273-delete_volume" released by "delete_volume" :: held 3.357s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:30:49 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:30:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Flow 'volume_create_manager' (fca57971-b209-4e8c-8f78-6913405601c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:30:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d76038d-c771-4a53-ac54-364418103831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d76038d-c771-4a53-ac54-364418103831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1447580077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d8f0b4-e53e-432f-a4dd-0fc0a899199b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='643fcaec511d4873af5e4319f656d0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:50Z,use_quota=True,user_id='72c2fd456aff413184a7dc15083d33d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7dfd61c-9d84-41da-8345-feaa04b2565b),volume_type_id=a7dfd61c-9d84-41da-8345-feaa04b2565b)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d60987-1799-4b9a-8642-a737c703d2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d60987-1799-4b9a-8642-a737c703d2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6deec5b-a39f-4fff-80a6-94a498ca6e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6deec5b-a39f-4fff-80a6-94a498ca6e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16d8f0b4-e53e-432f-a4dd-0fc0a899199b', 'volume_name': 'volume-16d8f0b4-e53e-432f-a4dd-0fc0a899199b', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3bca8e2-e688-4815-b4aa-aac30b9469f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3bca8e2-e688-4815-b4aa-aac30b9469f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c6ece79-f8d4-4459-a3dd-a6371a820621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:49 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Volume 16d8f0b4-e53e-432f-a4dd-0fc0a899199b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16d8f0b4-e53e-432f-a4dd-0fc0a899199b', 'volume_size': 1} Jul 06 15:30:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1447580077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d8f0b4-e53e-432f-a4dd-0fc0a899199b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='643fcaec511d4873af5e4319f656d0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:50Z,use_quota=True,user_id='72c2fd456aff413184a7dc15083d33d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7dfd61c-9d84-41da-8345-feaa04b2565b),volume_type_id=a7dfd61c-9d84-41da-8345-feaa04b2565b)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:30:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Creating volume 16d8f0b4-e53e-432f-a4dd-0fc0a899199b {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:30:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:30:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:30:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:30:49 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:30:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-16d8f0b4-e53e-432f-a4dd-0fc0a899199b 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:49 devstack sudo[93516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-16d8f0b4-e53e-432f-a4dd-0fc0a899199b 1073741824 Jul 06 15:30:49 devstack sudo[93516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:51 devstack sudo[93516]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-16d8f0b4-e53e-432f-a4dd-0fc0a899199b 1073741824" returned: 0 in 1.631s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-16d8f0b4-e53e-432f-a4dd-0fc0a899199b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:51 devstack sudo[93538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-16d8f0b4-e53e-432f-a4dd-0fc0a899199b Jul 06 15:30:51 devstack sudo[93538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:53 devstack sudo[93538]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-16d8f0b4-e53e-432f-a4dd-0fc0a899199b" returned: 0 in 1.752s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:53 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] <== create_volume: return (3466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:30:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.469s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c6ece79-f8d4-4459-a3dd-a6371a820621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16d8f0b4-e53e-432f-a4dd-0fc0a899199b', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (430d9b50-a63d-4136-8c64-ce0ca8e90ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:53 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Volume volume-16d8f0b4-e53e-432f-a4dd-0fc0a899199b (16d8f0b4-e53e-432f-a4dd-0fc0a899199b): created successfully Jul 06 15:30:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (430d9b50-a63d-4136-8c64-ce0ca8e90ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Flow 'volume_create_manager' (fca57971-b209-4e8c-8f78-6913405601c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:30:53 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-e1eff42a-b500-4b53-b9e7-39d466cbe5b8 tempest-VolumeTypesAccessTest-1228351210 None] Created volume successfully. Jul 06 15:30:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-eacd7914-fcfc-4c81-814e-d65e5b1aa05b tempest-VolumeTypesAccessTest-1228351210 None] Acquiring lock "cinder-16d8f0b4-e53e-432f-a4dd-0fc0a899199b-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:30:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-eacd7914-fcfc-4c81-814e-d65e5b1aa05b tempest-VolumeTypesAccessTest-1228351210 None] Lock "cinder-16d8f0b4-e53e-432f-a4dd-0fc0a899199b-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:30:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-eacd7914-fcfc-4c81-814e-d65e5b1aa05b tempest-VolumeTypesAccessTest-1228351210 None] Acquiring lock "cinder-quobyte-16d8f0b4-e53e-432f-a4dd-0fc0a899199b" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:30:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-eacd7914-fcfc-4c81-814e-d65e5b1aa05b tempest-VolumeTypesAccessTest-1228351210 None] Lock "cinder-quobyte-16d8f0b4-e53e-432f-a4dd-0fc0a899199b" acquired by "delete_volume" :: waited 0.067s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:30:54 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e34ec9-b04c-4c08-a019-aa4b54894dd4]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:30:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-eacd7914-fcfc-4c81-814e-d65e5b1aa05b tempest-VolumeTypesAccessTest-1228351210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-16d8f0b4-e53e-432f-a4dd-0fc0a899199b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:54 devstack sudo[93553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-16d8f0b4-e53e-432f-a4dd-0fc0a899199b Jul 06 15:30:54 devstack sudo[93553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d42d03a2-2fd0-472a-b11c-45a89ea580f3 tempest-VolumesActionsTest-611226632 None] Acquiring lock "cinder-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9" by "attach_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:30:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d42d03a2-2fd0-472a-b11c-45a89ea580f3 tempest-VolumesActionsTest-611226632 None] Lock "cinder-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9" acquired by "attach_volume" :: waited 0.039s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:30:55 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-d42d03a2-2fd0-472a-b11c-45a89ea580f3 tempest-VolumesActionsTest-611226632 None] Attaching volume 31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 to instance 6942d39c-1406-4f8a-b997-d8b6457789ac at mountpoint /dev/vdb on host None. Jul 06 15:30:55 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-d42d03a2-2fd0-472a-b11c-45a89ea580f3 tempest-VolumesActionsTest-611226632 None] Attach volume completed successfully. Jul 06 15:30:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d42d03a2-2fd0-472a-b11c-45a89ea580f3 tempest-VolumesActionsTest-611226632 None] Lock "cinder-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9" released by "attach_volume" :: held 0.178s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:30:56 devstack sudo[93553]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-eacd7914-fcfc-4c81-814e-d65e5b1aa05b tempest-VolumeTypesAccessTest-1228351210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-16d8f0b4-e53e-432f-a4dd-0fc0a899199b" returned: 0 in 1.379s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-eacd7914-fcfc-4c81-814e-d65e5b1aa05b tempest-VolumeTypesAccessTest-1228351210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-16d8f0b4-e53e-432f-a4dd-0fc0a899199b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:56 devstack sudo[93558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-16d8f0b4-e53e-432f-a4dd-0fc0a899199b Jul 06 15:30:56 devstack sudo[93558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-3bd208f9-9db8-4886-ad12-0e17588aa188 tempest-VolumesActionsTest-611226632 None] Acquiring lock "cinder-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9-detach_volume" by "detach_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:30:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-3bd208f9-9db8-4886-ad12-0e17588aa188 tempest-VolumesActionsTest-611226632 None] Lock "cinder-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:30:56 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-3bd208f9-9db8-4886-ad12-0e17588aa188 tempest-VolumesActionsTest-611226632 None] Detaching volume 31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 from instance 6942d39c-1406-4f8a-b997-d8b6457789ac. Jul 06 15:30:56 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-3bd208f9-9db8-4886-ad12-0e17588aa188 tempest-VolumesActionsTest-611226632 None] Detach volume completed successfully. Jul 06 15:30:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-3bd208f9-9db8-4886-ad12-0e17588aa188 tempest-VolumesActionsTest-611226632 None] Lock "cinder-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9-detach_volume" released by "detach_volume" :: held 0.107s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:30:57 devstack sudo[93558]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-eacd7914-fcfc-4c81-814e-d65e5b1aa05b tempest-VolumeTypesAccessTest-1228351210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-16d8f0b4-e53e-432f-a4dd-0fc0a899199b" returned: 0 in 0.891s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:57 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-eacd7914-fcfc-4c81-814e-d65e5b1aa05b tempest-VolumeTypesAccessTest-1228351210 None] Lock "cinder-quobyte-16d8f0b4-e53e-432f-a4dd-0fc0a899199b" released by "delete_volume" :: held 2.346s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:30:57 devstack cinder-volume[86148]: WARNING cinder.quota [None req-eacd7914-fcfc-4c81-814e-d65e5b1aa05b tempest-VolumeTypesAccessTest-1228351210 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1666559914 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1666559914, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:30:57 devstack cinder-volume[86148]: WARNING cinder.quota [None req-eacd7914-fcfc-4c81-814e-d65e5b1aa05b tempest-VolumeTypesAccessTest-1228351210 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1666559914 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1666559914, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:30:57 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-eacd7914-fcfc-4c81-814e-d65e5b1aa05b tempest-VolumeTypesAccessTest-1228351210 None] Created reservations ['510daca8-68c1-47bc-a852-3bcbab0d5ad5', 'bfb8e82c-fdbc-4dfb-ab02-2202225bf289', '535b9262-1cd4-45d7-9678-f89c6f547e88', '4abe4dfd-5484-4a1d-b732-86b95a643750'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:30:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-eacd7914-fcfc-4c81-814e-d65e5b1aa05b tempest-VolumeTypesAccessTest-1228351210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-eacd7914-fcfc-4c81-814e-d65e5b1aa05b tempest-VolumeTypesAccessTest-1228351210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:57 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-eacd7914-fcfc-4c81-814e-d65e5b1aa05b tempest-VolumeTypesAccessTest-1228351210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:30:57 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-eacd7914-fcfc-4c81-814e-d65e5b1aa05b tempest-VolumeTypesAccessTest-1228351210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:30:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-eacd7914-fcfc-4c81-814e-d65e5b1aa05b tempest-VolumeTypesAccessTest-1228351210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-eacd7914-fcfc-4c81-814e-d65e5b1aa05b tempest-VolumeTypesAccessTest-1228351210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:57 devstack sudo[93561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:30:57 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:58 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-eacd7914-fcfc-4c81-814e-d65e5b1aa05b tempest-VolumeTypesAccessTest-1228351210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.783s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:58 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-eacd7914-fcfc-4c81-814e-d65e5b1aa05b tempest-VolumeTypesAccessTest-1228351210 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:30:58 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-eacd7914-fcfc-4c81-814e-d65e5b1aa05b tempest-VolumeTypesAccessTest-1228351210 None] Deleted volume successfully. Jul 06 15:30:58 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-eacd7914-fcfc-4c81-814e-d65e5b1aa05b tempest-VolumeTypesAccessTest-1228351210 None] Lock "cinder-16d8f0b4-e53e-432f-a4dd-0fc0a899199b-delete_volume" released by "delete_volume" :: held 3.585s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:31:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-dd8822fa-0fb9-4cee-b806-086193dc0baf tempest-VolumesActionsTest-611226632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-dd8822fa-0fb9-4cee-b806-086193dc0baf tempest-VolumesActionsTest-611226632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:06 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[452d0fc1-9e3f-4952-9025-7389fc3c7b48]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dd8822fa-0fb9-4cee-b806-086193dc0baf tempest-VolumesActionsTest-611226632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:07 devstack sudo[93633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 Jul 06 15:31:07 devstack sudo[93633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:07 devstack sudo[93633]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dd8822fa-0fb9-4cee-b806-086193dc0baf tempest-VolumesActionsTest-611226632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9" returned: 0 in 0.872s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:07 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00f564e-138e-4d79-bb5d-a78aebc28f7f]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dd8822fa-0fb9-4cee-b806-086193dc0baf tempest-VolumesActionsTest-611226632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:07 devstack sudo[93639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 Jul 06 15:31:07 devstack sudo[93639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:08 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=21,cinder:UPDATE=24,cinder:DELETE=3,cinder:INSERT=6 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:31:08 devstack sudo[93639]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dd8822fa-0fb9-4cee-b806-086193dc0baf tempest-VolumesActionsTest-611226632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9" returned: 0 in 0.873s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dd8822fa-0fb9-4cee-b806-086193dc0baf tempest-VolumesActionsTest-611226632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 /opt/stack/data/cinder/conversion/31ca9d4b-062e-4c5f-9937-ea60c9dac5d9.temp_image.42015e30-f79c-4851-a097-a8e9262ef35b21_q5v55.img {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:08 devstack sudo[93646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 /opt/stack/data/cinder/conversion/31ca9d4b-062e-4c5f-9937-ea60c9dac5d9.temp_image.42015e30-f79c-4851-a097-a8e9262ef35b21_q5v55.img Jul 06 15:31:08 devstack sudo[93646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:08 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:31:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Flow 'volume_create_manager' (9ffa6a9c-6aba-4344-bd09-ef95b4496dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:31:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d466fb25-e3c4-4549-835d-7e82e24e2906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d466fb25-e3c4-4549-835d-7e82e24e2906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1094045781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c60d92ff-7d89-462f-b2eb-641c630f0e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08947cc3e3d842c3b9b7fcab7a9ac8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:31:09Z,use_quota=True,user_id='463e8e82ccb4498081e21608dbc6694f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e342c55d-bf7e-4fb4-bef4-7ea1152f6f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e342c55d-bf7e-4fb4-bef4-7ea1152f6f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c01d05-c3c1-4a6e-9c4a-667e9f0c6327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c01d05-c3c1-4a6e-9c4a-667e9f0c6327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c60d92ff-7d89-462f-b2eb-641c630f0e5c', 'volume_name': 'volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16fee4d7-5c49-48ef-b3dc-32848664d7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16fee4d7-5c49-48ef-b3dc-32848664d7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4ea6542-e5a7-4f7b-a817-0ed60627bfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:08 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Volume c60d92ff-7d89-462f-b2eb-641c630f0e5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c', 'volume_size': 1} Jul 06 15:31:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:13 devstack sudo[93646]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dd8822fa-0fb9-4cee-b806-086193dc0baf tempest-VolumesActionsTest-611226632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 /opt/stack/data/cinder/conversion/31ca9d4b-062e-4c5f-9937-ea60c9dac5d9.temp_image.42015e30-f79c-4851-a097-a8e9262ef35b21_q5v55.img" returned: 0 in 5.210s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:13 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd62cf8-9a6e-4ae3-923a-cd686eef6b29]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dd8822fa-0fb9-4cee-b806-086193dc0baf tempest-VolumesActionsTest-611226632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:14 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 Jul 06 15:31:14 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:14 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:31:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Flow 'volume_create_manager' (8f319e74-a310-40d0-a153-cd1361dc1bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:31:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (891a811b-df82-4cbd-b2d4-39b3cb3207ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (891a811b-df82-4cbd-b2d4-39b3cb3207ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-490587055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5abdd3edecc34be1b9e0eec22e216751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:31:14Z,use_quota=True,user_id='c73e587730e94979a0ab467fe16d3249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c4b69d7-156a-40cb-bb19-6ea9fb50db68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c4b69d7-156a-40cb-bb19-6ea9fb50db68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3085fa86-c912-49bd-8c80-b71f1ef617dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3085fa86-c912-49bd-8c80-b71f1ef617dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d', 'volume_name': 'volume-4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e014a225-c401-453a-92de-f06d33738242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e014a225-c401-453a-92de-f06d33738242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75985d9b-c89f-485d-9388-09aaff1c77f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:14 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Volume 4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d', 'volume_size': 1} Jul 06 15:31:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:14 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dd8822fa-0fb9-4cee-b806-086193dc0baf tempest-VolumesActionsTest-611226632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9" returned: 0 in 1.094s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:14 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-dd8822fa-0fb9-4cee-b806-086193dc0baf tempest-VolumesActionsTest-611226632 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9, size 1024.00 MB, duration 5.21 sec, destination /opt/stack/data/cinder/conversion/31ca9d4b-062e-4c5f-9937-ea60c9dac5d9.temp_image.42015e30-f79c-4851-a097-a8e9262ef35b21_q5v55.img {{(pid=86148) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:31:14 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-dd8822fa-0fb9-4cee-b806-086193dc0baf tempest-VolumesActionsTest-611226632 None] Converted 1024.00 MB image at 196.51 MB/s Jul 06 15:31:15 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-dd8822fa-0fb9-4cee-b806-086193dc0baf tempest-VolumesActionsTest-611226632 None] 42015e30-f79c-4851-a097-a8e9262ef35b was raw, no need to convert to raw {{(pid=86148) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 06 15:31:17 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:31:17 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Flow 'volume_create_manager' (a8312aec-cb16-4132-93b1-0d65ac17761d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:31:17 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3361709a-31c5-4e93-a8ae-06cd9437bcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:17 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3361709a-31c5-4e93-a8ae-06cd9437bcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-330087521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a10864-ada5-4dd8-a439-7bb9e7d945f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c45904797864f8493a520651b327e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:31:17Z,use_quota=True,user_id='309365767b814ec0840ec934b3ec107c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:17 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3d0b06-c448-4dda-a629-ea26820d225a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:17 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3d0b06-c448-4dda-a629-ea26820d225a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:17 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec30b68-0c03-4254-ab82-3f11cdf18d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:17 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec30b68-0c03-4254-ab82-3f11cdf18d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39a10864-ada5-4dd8-a439-7bb9e7d945f6', 'volume_name': 'volume-39a10864-ada5-4dd8-a439-7bb9e7d945f6', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:17 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d99099-86de-4a77-b783-152a503a38cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:17 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d99099-86de-4a77-b783-152a503a38cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:17 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2d2ab3a-f3d0-4000-b1b4-ba2b975c723f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:17 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Volume 39a10864-ada5-4dd8-a439-7bb9e7d945f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39a10864-ada5-4dd8-a439-7bb9e7d945f6', 'volume_size': 1} Jul 06 15:31:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:27 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=37,cinder:UPDATE=36,cinder:INSERT=10,cinder:DELETE=1 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:31:27 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:31:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-dd8822fa-0fb9-4cee-b806-086193dc0baf tempest-VolumesActionsTest-611226632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.104s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dd8822fa-0fb9-4cee-b806-086193dc0baf tempest-VolumesActionsTest-611226632 None] Uploaded volume to glance image-id: 42015e30-f79c-4851-a097-a8e9262ef35b. {{(pid=86148) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 06 15:31:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.146s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1094045781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c60d92ff-7d89-462f-b2eb-641c630f0e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08947cc3e3d842c3b9b7fcab7a9ac8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:31:09Z,use_quota=True,user_id='463e8e82ccb4498081e21608dbc6694f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:31:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Creating volume c60d92ff-7d89-462f-b2eb-641c630f0e5c {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:31:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:31:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:31:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:31:33 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:31:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:34 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c 1073741824 Jul 06 15:31:34 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:34 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-dd8822fa-0fb9-4cee-b806-086193dc0baf tempest-VolumesActionsTest-611226632 None] Copy volume to image completed successfully. Jul 06 15:31:34 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c 1073741824" returned: 0 in 0.859s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:34 devstack sudo[93737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c Jul 06 15:31:34 devstack sudo[93737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:35 devstack sudo[93737]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c" returned: 0 in 0.665s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:35 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:31:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.208s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:35 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-490587055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5abdd3edecc34be1b9e0eec22e216751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:31:14Z,use_quota=True,user_id='c73e587730e94979a0ab467fe16d3249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:31:35 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Creating volume 4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:31:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:35 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:31:35 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:31:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:35 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:31:35 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:31:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4ea6542-e5a7-4f7b-a817-0ed60627bfd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:35 devstack sudo[93740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d 1073741824 Jul 06 15:31:35 devstack sudo[93740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be5d6d3-5522-4548-b57d-5da6e1594152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:35 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Volume volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c (c60d92ff-7d89-462f-b2eb-641c630f0e5c): created successfully Jul 06 15:31:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be5d6d3-5522-4548-b57d-5da6e1594152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Flow 'volume_create_manager' (9ffa6a9c-6aba-4344-bd09-ef95b4496dbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:31:35 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-f8979d85-d284-4a7e-8295-5435e5216b74 tempest-SnapshotMetadataTestJSON-837762831 None] Created volume successfully. Jul 06 15:31:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3d7033eb-dc49-4cab-98ed-580ae855fc3a tempest-SnapshotMetadataTestJSON-837762831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a997df9b-4951-4b5c-ac04-603f37d0bba4 tempest-VolumesActionsTest-611226632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:36 devstack sudo[93740]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d 1073741824" returned: 0 in 0.895s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:36 devstack sudo[93745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d Jul 06 15:31:36 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:37 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d" returned: 0 in 0.626s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:31:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.771s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-330087521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a10864-ada5-4dd8-a439-7bb9e7d945f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c45904797864f8493a520651b327e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:31:17Z,use_quota=True,user_id='309365767b814ec0840ec934b3ec107c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:31:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Creating volume 39a10864-ada5-4dd8-a439-7bb9e7d945f6 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:31:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:31:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:31:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:31:37 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:31:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-39a10864-ada5-4dd8-a439-7bb9e7d945f6 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:37 devstack sudo[93750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-39a10864-ada5-4dd8-a439-7bb9e7d945f6 1073741824 Jul 06 15:31:37 devstack sudo[93750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:37 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75985d9b-c89f-485d-9388-09aaff1c77f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:37 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c086aacb-e79e-451d-a41c-fada8b481655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:37 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Volume volume-4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d (4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d): created successfully Jul 06 15:31:37 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c086aacb-e79e-451d-a41c-fada8b481655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:37 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Flow 'volume_create_manager' (8f319e74-a310-40d0-a153-cd1361dc1bce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:31:37 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-abbb44af-1738-460e-8d4a-f9a5f145ebf8 tempest-AttachVolumeTestJSON-1381247220 None] Created volume successfully. Jul 06 15:31:37 devstack sudo[93750]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-39a10864-ada5-4dd8-a439-7bb9e7d945f6 1073741824" returned: 0 in 0.786s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-39a10864-ada5-4dd8-a439-7bb9e7d945f6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:37 devstack sudo[93760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-39a10864-ada5-4dd8-a439-7bb9e7d945f6 Jul 06 15:31:37 devstack sudo[93760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:31:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:31:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:31:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:38 devstack sudo[93763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:31:38 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:38 devstack sudo[93760]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-39a10864-ada5-4dd8-a439-7bb9e7d945f6" returned: 0 in 0.639s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:31:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3d7033eb-dc49-4cab-98ed-580ae855fc3a tempest-SnapshotMetadataTestJSON-837762831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.624s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2d2ab3a-f3d0-4000-b1b4-ba2b975c723f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39a10864-ada5-4dd8-a439-7bb9e7d945f6', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a03b42-a2f2-4c70-9d18-d81d823c77f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-3d7033eb-dc49-4cab-98ed-580ae855fc3a tempest-SnapshotMetadataTestJSON-837762831 None] Creating offline snapshot 85ecdec6-fa8c-489d-9516-46baffe28029 of volume c60d92ff-7d89-462f-b2eb-641c630f0e5c {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:31:38 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Volume volume-39a10864-ada5-4dd8-a439-7bb9e7d945f6 (39a10864-ada5-4dd8-a439-7bb9e7d945f6): created successfully Jul 06 15:31:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a03b42-a2f2-4c70-9d18-d81d823c77f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Flow 'volume_create_manager' (a8312aec-cb16-4132-93b1-0d65ac17761d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:31:38 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16c8e8a-7be9-4fe7-bcd7-a5fe61258066]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3d7033eb-dc49-4cab-98ed-580ae855fc3a tempest-SnapshotMetadataTestJSON-837762831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:38 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-b65e5083-5150-429d-9aeb-f340b42bb538 tempest-AttachVolumeNegativeTest-823541462 None] Created volume successfully. Jul 06 15:31:38 devstack sudo[93766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c Jul 06 15:31:38 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:39 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.657s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:31:39 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager._thread_info {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:31:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread count: 28 {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:31:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread info: [<_MainThread(MainThread, started 124857273856128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:31:39 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3d7033eb-dc49-4cab-98ed-580ae855fc3a tempest-SnapshotMetadataTestJSON-837762831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c" returned: 0 in 0.761s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3d7033eb-dc49-4cab-98ed-580ae855fc3a tempest-SnapshotMetadataTestJSON-837762831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c.85ecdec6-fa8c-489d-9516-46baffe28029 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:39 devstack sudo[93772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c.85ecdec6-fa8c-489d-9516-46baffe28029 1G Jul 06 15:31:39 devstack sudo[93772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:40 devstack sudo[93772]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3d7033eb-dc49-4cab-98ed-580ae855fc3a tempest-SnapshotMetadataTestJSON-837762831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c.85ecdec6-fa8c-489d-9516-46baffe28029 1G" returned: 0 in 0.803s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3d7033eb-dc49-4cab-98ed-580ae855fc3a tempest-SnapshotMetadataTestJSON-837762831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c.85ecdec6-fa8c-489d-9516-46baffe28029 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:40 devstack sudo[93782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c.85ecdec6-fa8c-489d-9516-46baffe28029 Jul 06 15:31:40 devstack sudo[93782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-a24453b3-d4a5-40e6-8cd6-893ca965f487 req-bf2b9b39-d0f8-4b54-b901-785b6fe4b19f tempest-AttachVolumeTestJSON-1381247220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:40 devstack sudo[93782]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3d7033eb-dc49-4cab-98ed-580ae855fc3a tempest-SnapshotMetadataTestJSON-837762831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c.85ecdec6-fa8c-489d-9516-46baffe28029" returned: 0 in 0.690s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:40 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-3d7033eb-dc49-4cab-98ed-580ae855fc3a tempest-SnapshotMetadataTestJSON-837762831 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c.85ecdec6-fa8c-489d-9516-46baffe28029 is being set with open permissions: ugo+rw Jul 06 15:31:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3d7033eb-dc49-4cab-98ed-580ae855fc3a tempest-SnapshotMetadataTestJSON-837762831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c.85ecdec6-fa8c-489d-9516-46baffe28029 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:40 devstack sudo[93796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c.85ecdec6-fa8c-489d-9516-46baffe28029 Jul 06 15:31:40 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:41 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3d7033eb-dc49-4cab-98ed-580ae855fc3a tempest-SnapshotMetadataTestJSON-837762831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c.85ecdec6-fa8c-489d-9516-46baffe28029" returned: 0 in 0.637s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3d7033eb-dc49-4cab-98ed-580ae855fc3a tempest-SnapshotMetadataTestJSON-837762831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:41 devstack sudo[93799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c.info Jul 06 15:31:41 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:42 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3d7033eb-dc49-4cab-98ed-580ae855fc3a tempest-SnapshotMetadataTestJSON-837762831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c.info" returned: 0 in 0.662s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:42 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-3d7033eb-dc49-4cab-98ed-580ae855fc3a tempest-SnapshotMetadataTestJSON-837762831 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c.info is being set with open permissions: ugo+rw Jul 06 15:31:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3d7033eb-dc49-4cab-98ed-580ae855fc3a tempest-SnapshotMetadataTestJSON-837762831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:42 devstack sudo[93803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c.info Jul 06 15:31:42 devstack sudo[93803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-fcc1c82a-4231-4c73-b086-a4624ac5fecf req-8f2f3de7-dd31-42c5-8e86-27264861fc44 tempest-AttachVolumeNegativeTest-823541462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:42 devstack sudo[93803]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3d7033eb-dc49-4cab-98ed-580ae855fc3a tempest-SnapshotMetadataTestJSON-837762831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c.info" returned: 0 in 0.644s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3d7033eb-dc49-4cab-98ed-580ae855fc3a tempest-SnapshotMetadataTestJSON-837762831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.323s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a997df9b-4951-4b5c-ac04-603f37d0bba4 tempest-VolumesActionsTest-611226632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 6.936s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:42 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e03a6c-6eab-43b1-978f-875d52ef864c]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a997df9b-4951-4b5c-ac04-603f37d0bba4 tempest-VolumesActionsTest-611226632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:42 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-3d7033eb-dc49-4cab-98ed-580ae855fc3a tempest-SnapshotMetadataTestJSON-837762831 None] Create snapshot completed successfully Jul 06 15:31:43 devstack sudo[93814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 Jul 06 15:31:43 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:43 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a997df9b-4951-4b5c-ac04-603f37d0bba4 tempest-VolumesActionsTest-611226632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9" returned: 0 in 0.770s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:43 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5550d9-951f-4e1d-bfb5-897b58e68a3e]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a997df9b-4951-4b5c-ac04-603f37d0bba4 tempest-VolumesActionsTest-611226632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:43 devstack sudo[93819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 Jul 06 15:31:43 devstack sudo[93819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:44 devstack sudo[93819]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a997df9b-4951-4b5c-ac04-603f37d0bba4 tempest-VolumesActionsTest-611226632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9" returned: 0 in 0.729s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a997df9b-4951-4b5c-ac04-603f37d0bba4 tempest-VolumesActionsTest-611226632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 /opt/stack/data/cinder/conversion/31ca9d4b-062e-4c5f-9937-ea60c9dac5d9.temp_image.0f27556b-529e-4062-8fb9-503328da8be24y82y18a.img {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:44 devstack sudo[93824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 /opt/stack/data/cinder/conversion/31ca9d4b-062e-4c5f-9937-ea60c9dac5d9.temp_image.0f27556b-529e-4062-8fb9-503328da8be24y82y18a.img Jul 06 15:31:44 devstack sudo[93824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:48 devstack sudo[93824]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a997df9b-4951-4b5c-ac04-603f37d0bba4 tempest-VolumesActionsTest-611226632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 /opt/stack/data/cinder/conversion/31ca9d4b-062e-4c5f-9937-ea60c9dac5d9.temp_image.0f27556b-529e-4062-8fb9-503328da8be24y82y18a.img" returned: 0 in 4.228s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:48 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eea1139-9fa8-4d9f-ac0e-9214b2fb3b21]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a997df9b-4951-4b5c-ac04-603f37d0bba4 tempest-VolumesActionsTest-611226632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:48 devstack sudo[93839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 Jul 06 15:31:48 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:49 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a997df9b-4951-4b5c-ac04-603f37d0bba4 tempest-VolumesActionsTest-611226632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9" returned: 0 in 0.948s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:49 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-a997df9b-4951-4b5c-ac04-603f37d0bba4 tempest-VolumesActionsTest-611226632 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9, size 1024.00 MB, duration 4.23 sec, destination /opt/stack/data/cinder/conversion/31ca9d4b-062e-4c5f-9937-ea60c9dac5d9.temp_image.0f27556b-529e-4062-8fb9-503328da8be24y82y18a.img {{(pid=86148) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:31:49 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-a997df9b-4951-4b5c-ac04-603f37d0bba4 tempest-VolumesActionsTest-611226632 None] Converted 1024.00 MB image at 242.11 MB/s Jul 06 15:31:49 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-a997df9b-4951-4b5c-ac04-603f37d0bba4 tempest-VolumesActionsTest-611226632 None] 0f27556b-529e-4062-8fb9-503328da8be2 was raw, converting to qcow2 {{(pid=86148) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 06 15:31:49 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[e955954b-4b93-456d-9ffa-43c42aa39f0e]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a997df9b-4951-4b5c-ac04-603f37d0bba4 tempest-VolumesActionsTest-611226632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/31ca9d4b-062e-4c5f-9937-ea60c9dac5d9.temp_image.0f27556b-529e-4062-8fb9-503328da8be24y82y18a.img {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:49 devstack sudo[93857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/31ca9d4b-062e-4c5f-9937-ea60c9dac5d9.temp_image.0f27556b-529e-4062-8fb9-503328da8be24y82y18a.img Jul 06 15:31:49 devstack sudo[93857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:50 devstack sudo[93857]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a997df9b-4951-4b5c-ac04-603f37d0bba4 tempest-VolumesActionsTest-611226632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/31ca9d4b-062e-4c5f-9937-ea60c9dac5d9.temp_image.0f27556b-529e-4062-8fb9-503328da8be24y82y18a.img" returned: 0 in 0.696s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a997df9b-4951-4b5c-ac04-603f37d0bba4 tempest-VolumesActionsTest-611226632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/31ca9d4b-062e-4c5f-9937-ea60c9dac5d9.temp_image.0f27556b-529e-4062-8fb9-503328da8be24y82y18a.img {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:50 devstack sudo[93861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/31ca9d4b-062e-4c5f-9937-ea60c9dac5d9.temp_image.0f27556b-529e-4062-8fb9-503328da8be24y82y18a.img Jul 06 15:31:50 devstack sudo[93861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:51 devstack sudo[93861]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a997df9b-4951-4b5c-ac04-603f37d0bba4 tempest-VolumesActionsTest-611226632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/31ca9d4b-062e-4c5f-9937-ea60c9dac5d9.temp_image.0f27556b-529e-4062-8fb9-503328da8be24y82y18a.img" returned: 1 in 0.690s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a997df9b-4951-4b5c-ac04-603f37d0bba4 tempest-VolumesActionsTest-611226632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/31ca9d4b-062e-4c5f-9937-ea60c9dac5d9.temp_image.0f27556b-529e-4062-8fb9-503328da8be24y82y18a.img' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:31:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a997df9b-4951-4b5c-ac04-603f37d0bba4 tempest-VolumesActionsTest-611226632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/31ca9d4b-062e-4c5f-9937-ea60c9dac5d9.temp_image.0f27556b-529e-4062-8fb9-503328da8be24y82y18a.img /opt/stack/data/cinder/conversion/vol_upload_0bc_285r {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:51 devstack sudo[93866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/31ca9d4b-062e-4c5f-9937-ea60c9dac5d9.temp_image.0f27556b-529e-4062-8fb9-503328da8be24y82y18a.img /opt/stack/data/cinder/conversion/vol_upload_0bc_285r Jul 06 15:31:51 devstack sudo[93866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:51 devstack sudo[93866]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a997df9b-4951-4b5c-ac04-603f37d0bba4 tempest-VolumesActionsTest-611226632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/31ca9d4b-062e-4c5f-9937-ea60c9dac5d9.temp_image.0f27556b-529e-4062-8fb9-503328da8be24y82y18a.img /opt/stack/data/cinder/conversion/vol_upload_0bc_285r" returned: 0 in 0.643s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:51 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-a997df9b-4951-4b5c-ac04-603f37d0bba4 tempest-VolumesActionsTest-611226632 None] Image conversion details: src /opt/stack/data/cinder/conversion/31ca9d4b-062e-4c5f-9937-ea60c9dac5d9.temp_image.0f27556b-529e-4062-8fb9-503328da8be24y82y18a.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_0bc_285r {{(pid=86148) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:31:51 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-a997df9b-4951-4b5c-ac04-603f37d0bba4 tempest-VolumesActionsTest-611226632 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 06 15:31:51 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b22073c-dd86-43c4-a0d5-7ed1de705c36]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a997df9b-4951-4b5c-ac04-603f37d0bba4 tempest-VolumesActionsTest-611226632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_0bc_285r {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:51 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_0bc_285r Jul 06 15:31:51 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:52 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a997df9b-4951-4b5c-ac04-603f37d0bba4 tempest-VolumesActionsTest-611226632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_0bc_285r" returned: 0 in 0.704s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a997df9b-4951-4b5c-ac04-603f37d0bba4 tempest-VolumesActionsTest-611226632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.717s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a997df9b-4951-4b5c-ac04-603f37d0bba4 tempest-VolumesActionsTest-611226632 None] Uploaded volume to glance image-id: 0f27556b-529e-4062-8fb9-503328da8be2. {{(pid=86148) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 06 15:31:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-a24453b3-d4a5-40e6-8cd6-893ca965f487 req-bf2b9b39-d0f8-4b54-b901-785b6fe4b19f tempest-AttachVolumeTestJSON-1381247220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.836s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:53 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[be46ec87-cec6-47b4-a341-d6da6d8217bf]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-a24453b3-d4a5-40e6-8cd6-893ca965f487 req-bf2b9b39-d0f8-4b54-b901-785b6fe4b19f tempest-AttachVolumeTestJSON-1381247220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:53 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a997df9b-4951-4b5c-ac04-603f37d0bba4 tempest-VolumesActionsTest-611226632 None] Copy volume to image completed successfully. Jul 06 15:31:53 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d Jul 06 15:31:53 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:54 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-a24453b3-d4a5-40e6-8cd6-893ca965f487 req-bf2b9b39-d0f8-4b54-b901-785b6fe4b19f tempest-AttachVolumeTestJSON-1381247220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d" returned: 0 in 0.777s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-a24453b3-d4a5-40e6-8cd6-893ca965f487 req-bf2b9b39-d0f8-4b54-b901-785b6fe4b19f tempest-AttachVolumeTestJSON-1381247220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.801s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-fcc1c82a-4231-4c73-b086-a4624ac5fecf req-8f2f3de7-dd31-42c5-8e86-27264861fc44 tempest-AttachVolumeNegativeTest-823541462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.670s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:54 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef68978-7954-409f-892a-8af34b3003f4]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-fcc1c82a-4231-4c73-b086-a4624ac5fecf req-8f2f3de7-dd31-42c5-8e86-27264861fc44 tempest-AttachVolumeNegativeTest-823541462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-39a10864-ada5-4dd8-a439-7bb9e7d945f6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-a24453b3-d4a5-40e6-8cd6-893ca965f487 req-bf2b9b39-d0f8-4b54-b901-785b6fe4b19f tempest-AttachVolumeTestJSON-1381247220 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce', 'name': 'volume-4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3c8c14c3-416d-4534-a818-8234f3294807', 'enforce_multipath': True} {{(pid=86148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:31:54 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-a24453b3-d4a5-40e6-8cd6-893ca965f487 req-bf2b9b39-d0f8-4b54-b901-785b6fe4b19f tempest-AttachVolumeTestJSON-1381247220 None] attachment_update completed successfully. Jul 06 15:31:54 devstack sudo[93887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-39a10864-ada5-4dd8-a439-7bb9e7d945f6 Jul 06 15:31:54 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:55 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-fcc1c82a-4231-4c73-b086-a4624ac5fecf req-8f2f3de7-dd31-42c5-8e86-27264861fc44 tempest-AttachVolumeNegativeTest-823541462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-39a10864-ada5-4dd8-a439-7bb9e7d945f6" returned: 0 in 0.828s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-fcc1c82a-4231-4c73-b086-a4624ac5fecf req-8f2f3de7-dd31-42c5-8e86-27264861fc44 tempest-AttachVolumeNegativeTest-823541462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.846s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:55 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-fcc1c82a-4231-4c73-b086-a4624ac5fecf req-8f2f3de7-dd31-42c5-8e86-27264861fc44 tempest-AttachVolumeNegativeTest-823541462 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce', 'name': 'volume-39a10864-ada5-4dd8-a439-7bb9e7d945f6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8bc2496d-8732-40f6-aa36-19c9051b2b76', 'enforce_multipath': True} {{(pid=86148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:31:55 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-fcc1c82a-4231-4c73-b086-a4624ac5fecf req-8f2f3de7-dd31-42c5-8e86-27264861fc44 tempest-AttachVolumeNegativeTest-823541462 None] attachment_update completed successfully. Jul 06 15:31:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e464d101-6bbe-489d-8854-0ba67a7d9fea tempest-VolumesActionsTest-611226632 None] Acquiring lock "cinder-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:31:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e464d101-6bbe-489d-8854-0ba67a7d9fea tempest-VolumesActionsTest-611226632 None] Lock "cinder-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:31:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e464d101-6bbe-489d-8854-0ba67a7d9fea tempest-VolumesActionsTest-611226632 None] Acquiring lock "cinder-quobyte-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:31:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e464d101-6bbe-489d-8854-0ba67a7d9fea tempest-VolumesActionsTest-611226632 None] Lock "cinder-quobyte-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9" acquired by "delete_volume" :: waited 0.021s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:31:55 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[321b1fc9-a20a-4c76-a0c4-a16b727e47f1]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e464d101-6bbe-489d-8854-0ba67a7d9fea tempest-VolumesActionsTest-611226632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:56 devstack sudo[94276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 Jul 06 15:31:56 devstack sudo[94276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-bce56471-0b88-4504-9475-cd9a19443472 tempest-SnapshotMetadataTestJSON-837762831 None] Acquiring lock "cinder-85ecdec6-fa8c-489d-9516-46baffe28029-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:31:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-bce56471-0b88-4504-9475-cd9a19443472 tempest-SnapshotMetadataTestJSON-837762831 None] Lock "cinder-85ecdec6-fa8c-489d-9516-46baffe28029-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:31:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-bce56471-0b88-4504-9475-cd9a19443472 tempest-SnapshotMetadataTestJSON-837762831 None] Acquiring lock "cinder-quobyte-c60d92ff-7d89-462f-b2eb-641c630f0e5c" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:31:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-bce56471-0b88-4504-9475-cd9a19443472 tempest-SnapshotMetadataTestJSON-837762831 None] Lock "cinder-quobyte-c60d92ff-7d89-462f-b2eb-641c630f0e5c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:31:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-bce56471-0b88-4504-9475-cd9a19443472 tempest-SnapshotMetadataTestJSON-837762831 None] Acquiring lock "cinder-quobyte-85ecdec6-fa8c-489d-9516-46baffe28029" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:31:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-bce56471-0b88-4504-9475-cd9a19443472 tempest-SnapshotMetadataTestJSON-837762831 None] Lock "cinder-quobyte-85ecdec6-fa8c-489d-9516-46baffe28029" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:31:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-bce56471-0b88-4504-9475-cd9a19443472 tempest-SnapshotMetadataTestJSON-837762831 None] Deleting offline snapshot 85ecdec6-fa8c-489d-9516-46baffe28029 of volume c60d92ff-7d89-462f-b2eb-641c630f0e5c {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:31:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-bce56471-0b88-4504-9475-cd9a19443472 tempest-SnapshotMetadataTestJSON-837762831 None] snapshot_file for this snap is: volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c.85ecdec6-fa8c-489d-9516-46baffe28029 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:31:56 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[479b97fc-ab32-43dc-940b-19fcdb50e905]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bce56471-0b88-4504-9475-cd9a19443472 tempest-SnapshotMetadataTestJSON-837762831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c.85ecdec6-fa8c-489d-9516-46baffe28029 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:56 devstack sudo[94278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c.85ecdec6-fa8c-489d-9516-46baffe28029 Jul 06 15:31:56 devstack sudo[94278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:56 devstack sudo[94276]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e464d101-6bbe-489d-8854-0ba67a7d9fea tempest-VolumesActionsTest-611226632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9" returned: 0 in 0.877s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e464d101-6bbe-489d-8854-0ba67a7d9fea tempest-VolumesActionsTest-611226632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:56 devstack sudo[94287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9 Jul 06 15:31:56 devstack sudo[94287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:56 devstack sudo[94278]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bce56471-0b88-4504-9475-cd9a19443472 tempest-SnapshotMetadataTestJSON-837762831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c.85ecdec6-fa8c-489d-9516-46baffe28029" returned: 0 in 0.772s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-bce56471-0b88-4504-9475-cd9a19443472 tempest-SnapshotMetadataTestJSON-837762831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:31:56 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[28958fb9-fbf0-4e5f-bed9-e39bd4559d12]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bce56471-0b88-4504-9475-cd9a19443472 tempest-SnapshotMetadataTestJSON-837762831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:57 devstack sudo[94291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c Jul 06 15:31:57 devstack sudo[94291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:57 devstack sudo[94287]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e464d101-6bbe-489d-8854-0ba67a7d9fea tempest-VolumesActionsTest-611226632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9" returned: 0 in 0.677s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:57 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e464d101-6bbe-489d-8854-0ba67a7d9fea tempest-VolumesActionsTest-611226632 None] Lock "cinder-quobyte-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9" released by "delete_volume" :: held 1.627s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:31:57 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-e464d101-6bbe-489d-8854-0ba67a7d9fea tempest-VolumesActionsTest-611226632 None] Created reservations ['cc414f89-230f-422d-8285-70f96c850fa5', '8742efde-296e-47f8-a416-f8f3c9519e9d', 'a970ea6c-3f17-467a-96c4-5a5ed5304368', '7b9b429e-2d91-46c7-a6de-577931b2466d'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:31:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e464d101-6bbe-489d-8854-0ba67a7d9fea tempest-VolumesActionsTest-611226632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e464d101-6bbe-489d-8854-0ba67a7d9fea tempest-VolumesActionsTest-611226632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:57 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e464d101-6bbe-489d-8854-0ba67a7d9fea tempest-VolumesActionsTest-611226632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:31:57 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e464d101-6bbe-489d-8854-0ba67a7d9fea tempest-VolumesActionsTest-611226632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:31:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e464d101-6bbe-489d-8854-0ba67a7d9fea tempest-VolumesActionsTest-611226632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e464d101-6bbe-489d-8854-0ba67a7d9fea tempest-VolumesActionsTest-611226632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:57 devstack sudo[94296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:31:57 devstack sudo[94296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:57 devstack sudo[94291]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bce56471-0b88-4504-9475-cd9a19443472 tempest-SnapshotMetadataTestJSON-837762831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c" returned: 0 in 0.801s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bce56471-0b88-4504-9475-cd9a19443472 tempest-SnapshotMetadataTestJSON-837762831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c.85ecdec6-fa8c-489d-9516-46baffe28029 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:57 devstack sudo[94299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c.85ecdec6-fa8c-489d-9516-46baffe28029 Jul 06 15:31:57 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:58 devstack sudo[94296]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e464d101-6bbe-489d-8854-0ba67a7d9fea tempest-VolumesActionsTest-611226632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.724s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:58 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-e464d101-6bbe-489d-8854-0ba67a7d9fea tempest-VolumesActionsTest-611226632 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:31:58 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-e464d101-6bbe-489d-8854-0ba67a7d9fea tempest-VolumesActionsTest-611226632 None] Deleted volume successfully. Jul 06 15:31:58 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e464d101-6bbe-489d-8854-0ba67a7d9fea tempest-VolumesActionsTest-611226632 None] Lock "cinder-31ca9d4b-062e-4c5f-9937-ea60c9dac5d9-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:31:58 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bce56471-0b88-4504-9475-cd9a19443472 tempest-SnapshotMetadataTestJSON-837762831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c.85ecdec6-fa8c-489d-9516-46baffe28029" returned: 0 in 0.811s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bce56471-0b88-4504-9475-cd9a19443472 tempest-SnapshotMetadataTestJSON-837762831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c.85ecdec6-fa8c-489d-9516-46baffe28029 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:58 devstack sudo[94306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c.85ecdec6-fa8c-489d-9516-46baffe28029 Jul 06 15:31:58 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:59 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bce56471-0b88-4504-9475-cd9a19443472 tempest-SnapshotMetadataTestJSON-837762831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c.85ecdec6-fa8c-489d-9516-46baffe28029" returned: 0 in 0.692s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-bce56471-0b88-4504-9475-cd9a19443472 tempest-SnapshotMetadataTestJSON-837762831 None] Lock "cinder-quobyte-85ecdec6-fa8c-489d-9516-46baffe28029" released by "_delete_snapshot" :: held 3.218s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:31:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-bce56471-0b88-4504-9475-cd9a19443472 tempest-SnapshotMetadataTestJSON-837762831 None] Lock "cinder-quobyte-c60d92ff-7d89-462f-b2eb-641c630f0e5c" released by "delete_snapshot" :: held 3.244s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:31:59 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-bce56471-0b88-4504-9475-cd9a19443472 tempest-SnapshotMetadataTestJSON-837762831 None] Created reservations ['f94f2849-04dc-4794-9b5a-d9dad378d728', 'f49bcb58-5298-43f1-b089-f1c4a27ea78e', '1690dd6c-b675-4c77-9962-1071ebd3a579', 'aa9a4595-9f68-4666-b2fe-e61b2816c604'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:31:59 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-bce56471-0b88-4504-9475-cd9a19443472 tempest-SnapshotMetadataTestJSON-837762831 None] Delete snapshot completed successfully. Jul 06 15:31:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-bce56471-0b88-4504-9475-cd9a19443472 tempest-SnapshotMetadataTestJSON-837762831 None] Lock "cinder-85ecdec6-fa8c-489d-9516-46baffe28029-delete_snapshot" released by "delete_snapshot" :: held 3.461s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:00 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:32:00 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Flow 'volume_create_manager' (a1c31ee6-e918-4178-a0d5-a0afd750b810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:32:00 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (524ce6b6-2a83-48e5-9a35-60a316dcd322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:00 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (524ce6b6-2a83-48e5-9a35-60a316dcd322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2039596743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c986d6ac-a9fe-490c-a669-526ca9b6d453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5abdd3edecc34be1b9e0eec22e216751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:00Z,use_quota=True,user_id='c73e587730e94979a0ab467fe16d3249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:00 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c387ed06-375b-4ed8-b73e-993d0e232e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:00 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c387ed06-375b-4ed8-b73e-993d0e232e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:00 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a4a0807-082b-4f49-b819-2e5489891d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:00 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a4a0807-082b-4f49-b819-2e5489891d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c986d6ac-a9fe-490c-a669-526ca9b6d453', 'volume_name': 'volume-c986d6ac-a9fe-490c-a669-526ca9b6d453', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:00 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ae358f-2d4a-4cb3-81fe-0bc81531d9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:00 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ae358f-2d4a-4cb3-81fe-0bc81531d9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:00 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8da0b43-828f-44db-9662-f96a51e731c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:00 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Volume c986d6ac-a9fe-490c-a669-526ca9b6d453: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c986d6ac-a9fe-490c-a669-526ca9b6d453', 'volume_size': 1} Jul 06 15:32:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:00 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2039596743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c986d6ac-a9fe-490c-a669-526ca9b6d453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5abdd3edecc34be1b9e0eec22e216751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:00Z,use_quota=True,user_id='c73e587730e94979a0ab467fe16d3249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:32:00 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Creating volume c986d6ac-a9fe-490c-a669-526ca9b6d453 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:32:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:00 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:00 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:00 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:32:00 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:32:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c986d6ac-a9fe-490c-a669-526ca9b6d453 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:00 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-26d7ad69-31a8-49b3-853a-784fd7e6f751 tempest-SnapshotMetadataTestJSON-837762831 None] Acquiring lock "cinder-c60d92ff-7d89-462f-b2eb-641c630f0e5c-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:32:00 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c986d6ac-a9fe-490c-a669-526ca9b6d453 1073741824 Jul 06 15:32:00 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:00 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-26d7ad69-31a8-49b3-853a-784fd7e6f751 tempest-SnapshotMetadataTestJSON-837762831 None] Lock "cinder-c60d92ff-7d89-462f-b2eb-641c630f0e5c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:32:00 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-26d7ad69-31a8-49b3-853a-784fd7e6f751 tempest-SnapshotMetadataTestJSON-837762831 None] Acquiring lock "cinder-quobyte-c60d92ff-7d89-462f-b2eb-641c630f0e5c" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:32:00 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-26d7ad69-31a8-49b3-853a-784fd7e6f751 tempest-SnapshotMetadataTestJSON-837762831 None] Lock "cinder-quobyte-c60d92ff-7d89-462f-b2eb-641c630f0e5c" acquired by "delete_volume" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:32:00 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5faa13a-4204-4ccf-9202-f579363d61f1]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:32:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-26d7ad69-31a8-49b3-853a-784fd7e6f751 tempest-SnapshotMetadataTestJSON-837762831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:00 devstack sudo[94312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c Jul 06 15:32:00 devstack sudo[94312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:01 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c986d6ac-a9fe-490c-a669-526ca9b6d453 1073741824" returned: 0 in 1.091s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c986d6ac-a9fe-490c-a669-526ca9b6d453 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:01 devstack sudo[94312]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-26d7ad69-31a8-49b3-853a-784fd7e6f751 tempest-SnapshotMetadataTestJSON-837762831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c" returned: 0 in 1.004s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-26d7ad69-31a8-49b3-853a-784fd7e6f751 tempest-SnapshotMetadataTestJSON-837762831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:01 devstack sudo[94321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c986d6ac-a9fe-490c-a669-526ca9b6d453 Jul 06 15:32:01 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:01 devstack sudo[94322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c Jul 06 15:32:01 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-26d7ad69-31a8-49b3-853a-784fd7e6f751 tempest-SnapshotMetadataTestJSON-837762831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c60d92ff-7d89-462f-b2eb-641c630f0e5c" returned: 0 in 0.866s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:02 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:02 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c986d6ac-a9fe-490c-a669-526ca9b6d453" returned: 0 in 0.929s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:02 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] <== create_volume: return (2111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:32:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.113s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:02 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-26d7ad69-31a8-49b3-853a-784fd7e6f751 tempest-SnapshotMetadataTestJSON-837762831 None] Lock "cinder-quobyte-c60d92ff-7d89-462f-b2eb-641c630f0e5c" released by "delete_volume" :: held 1.991s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8da0b43-828f-44db-9662-f96a51e731c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c986d6ac-a9fe-490c-a669-526ca9b6d453', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (429665c6-8df5-4dbf-9e9b-7962f720e442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:02 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Volume volume-c986d6ac-a9fe-490c-a669-526ca9b6d453 (c986d6ac-a9fe-490c-a669-526ca9b6d453): created successfully Jul 06 15:32:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (429665c6-8df5-4dbf-9e9b-7962f720e442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Flow 'volume_create_manager' (a1c31ee6-e918-4178-a0d5-a0afd750b810) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:32:02 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-c72523a6-ad46-4b00-a127-85d850713ce3 tempest-AttachVolumeTestJSON-1381247220 None] Created volume successfully. Jul 06 15:32:02 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-26d7ad69-31a8-49b3-853a-784fd7e6f751 tempest-SnapshotMetadataTestJSON-837762831 None] Created reservations ['baab3b04-5729-4dd1-898c-c323a5f14890', 'db6630bd-b31e-4a81-a3bc-4e7575428d4e', '08f9b8c2-958d-4d9c-8d2e-5a009aeb0a0e', '1e17e4b0-015d-4fd8-af85-f612b912af48'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:32:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-26d7ad69-31a8-49b3-853a-784fd7e6f751 tempest-SnapshotMetadataTestJSON-837762831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-26d7ad69-31a8-49b3-853a-784fd7e6f751 tempest-SnapshotMetadataTestJSON-837762831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:02 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-26d7ad69-31a8-49b3-853a-784fd7e6f751 tempest-SnapshotMetadataTestJSON-837762831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:02 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-26d7ad69-31a8-49b3-853a-784fd7e6f751 tempest-SnapshotMetadataTestJSON-837762831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-26d7ad69-31a8-49b3-853a-784fd7e6f751 tempest-SnapshotMetadataTestJSON-837762831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-26d7ad69-31a8-49b3-853a-784fd7e6f751 tempest-SnapshotMetadataTestJSON-837762831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:02 devstack sudo[94327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:32:02 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:03 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-26d7ad69-31a8-49b3-853a-784fd7e6f751 tempest-SnapshotMetadataTestJSON-837762831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.913s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:03 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-26d7ad69-31a8-49b3-853a-784fd7e6f751 tempest-SnapshotMetadataTestJSON-837762831 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:32:03 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-26d7ad69-31a8-49b3-853a-784fd7e6f751 tempest-SnapshotMetadataTestJSON-837762831 None] Deleted volume successfully. Jul 06 15:32:03 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-26d7ad69-31a8-49b3-853a-784fd7e6f751 tempest-SnapshotMetadataTestJSON-837762831 None] Lock "cinder-c60d92ff-7d89-462f-b2eb-641c630f0e5c-delete_volume" released by "delete_volume" :: held 3.191s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-2835f39b-638d-4e3c-99cb-3569a2c516b2 req-d1f07836-4742-43f7-af91-7c579beb4334 tempest-AttachVolumeTestJSON-1381247220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-2835f39b-638d-4e3c-99cb-3569a2c516b2 req-d1f07836-4742-43f7-af91-7c579beb4334 tempest-AttachVolumeTestJSON-1381247220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:06 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[743aa8d6-1478-4ccf-8d56-304f0ba4818a]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:32:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-2835f39b-638d-4e3c-99cb-3569a2c516b2 req-d1f07836-4742-43f7-af91-7c579beb4334 tempest-AttachVolumeTestJSON-1381247220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c986d6ac-a9fe-490c-a669-526ca9b6d453 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:06 devstack sudo[94348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c986d6ac-a9fe-490c-a669-526ca9b6d453 Jul 06 15:32:06 devstack sudo[94348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:07 devstack sudo[94348]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-2835f39b-638d-4e3c-99cb-3569a2c516b2 req-d1f07836-4742-43f7-af91-7c579beb4334 tempest-AttachVolumeTestJSON-1381247220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c986d6ac-a9fe-490c-a669-526ca9b6d453" returned: 0 in 0.966s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-2835f39b-638d-4e3c-99cb-3569a2c516b2 req-d1f07836-4742-43f7-af91-7c579beb4334 tempest-AttachVolumeTestJSON-1381247220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.993s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-2835f39b-638d-4e3c-99cb-3569a2c516b2 req-d1f07836-4742-43f7-af91-7c579beb4334 tempest-AttachVolumeTestJSON-1381247220 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce', 'name': 'volume-c986d6ac-a9fe-490c-a669-526ca9b6d453', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e94531b2-4829-4950-858f-a23e660acd84', 'enforce_multipath': True} {{(pid=86148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:32:07 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-2835f39b-638d-4e3c-99cb-3569a2c516b2 req-d1f07836-4742-43f7-af91-7c579beb4334 tempest-AttachVolumeTestJSON-1381247220 None] attachment_update completed successfully. Jul 06 15:32:08 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:32:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Flow 'volume_create_manager' (03160c54-9f5b-49a8-9925-0ffc4fabc460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:32:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98316ef5-d8ec-4204-b3fd-b7fb1b509a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98316ef5-d8ec-4204-b3fd-b7fb1b509a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-946510962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e69cebb-1b96-439f-8602-efbad3734e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee643049644942219b0c589e0eadb29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:08Z,use_quota=True,user_id='dda76eb0573c4f6bb8298689c6be9dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (421aa096-edd4-47da-acb2-9437ba478899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (421aa096-edd4-47da-acb2-9437ba478899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e23bcd9-fd38-480d-9250-88b56e47e9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e23bcd9-fd38-480d-9250-88b56e47e9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e69cebb-1b96-439f-8602-efbad3734e51', 'volume_name': 'volume-7e69cebb-1b96-439f-8602-efbad3734e51', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86738cd4-6ca9-4c0f-8f62-cd6128613b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86738cd4-6ca9-4c0f-8f62-cd6128613b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b026f9-1048-4717-9513-68533919184a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:08 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Volume 7e69cebb-1b96-439f-8602-efbad3734e51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e69cebb-1b96-439f-8602-efbad3734e51', 'volume_size': 1} Jul 06 15:32:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-946510962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e69cebb-1b96-439f-8602-efbad3734e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee643049644942219b0c589e0eadb29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:08Z,use_quota=True,user_id='dda76eb0573c4f6bb8298689c6be9dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:32:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Creating volume 7e69cebb-1b96-439f-8602-efbad3734e51 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:32:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:32:08 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:32:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7e69cebb-1b96-439f-8602-efbad3734e51 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:08 devstack sudo[94356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7e69cebb-1b96-439f-8602-efbad3734e51 1073741824 Jul 06 15:32:08 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:09 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7e69cebb-1b96-439f-8602-efbad3734e51 1073741824" returned: 0 in 1.046s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7e69cebb-1b96-439f-8602-efbad3734e51 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:09 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7e69cebb-1b96-439f-8602-efbad3734e51 Jul 06 15:32:09 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:10 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7e69cebb-1b96-439f-8602-efbad3734e51" returned: 0 in 0.972s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:10 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] <== create_volume: return (2062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:32:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.063s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b026f9-1048-4717-9513-68533919184a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e69cebb-1b96-439f-8602-efbad3734e51', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6b63b1-b743-42c6-be33-97dc321ba3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:10 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Volume volume-7e69cebb-1b96-439f-8602-efbad3734e51 (7e69cebb-1b96-439f-8602-efbad3734e51): created successfully Jul 06 15:32:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6b63b1-b743-42c6-be33-97dc321ba3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Flow 'volume_create_manager' (03160c54-9f5b-49a8-9925-0ffc4fabc460) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:32:10 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-938cfdb0-74ff-44a0-8136-a0cf122d8946 tempest-AbsoluteLimitsTests-672899650 None] Created volume successfully. Jul 06 15:32:11 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ee1e7484-4f71-434b-ad24-f92b8b4ece33 tempest-AbsoluteLimitsTests-672899650 None] Acquiring lock "cinder-7e69cebb-1b96-439f-8602-efbad3734e51-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:32:11 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ee1e7484-4f71-434b-ad24-f92b8b4ece33 tempest-AbsoluteLimitsTests-672899650 None] Lock "cinder-7e69cebb-1b96-439f-8602-efbad3734e51-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:32:11 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ee1e7484-4f71-434b-ad24-f92b8b4ece33 tempest-AbsoluteLimitsTests-672899650 None] Acquiring lock "cinder-quobyte-7e69cebb-1b96-439f-8602-efbad3734e51" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:32:11 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ee1e7484-4f71-434b-ad24-f92b8b4ece33 tempest-AbsoluteLimitsTests-672899650 None] Lock "cinder-quobyte-7e69cebb-1b96-439f-8602-efbad3734e51" acquired by "delete_volume" :: waited 0.024s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:32:11 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df10a91-751c-4e0e-9f7b-3834ad7ef316]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:32:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ee1e7484-4f71-434b-ad24-f92b8b4ece33 tempest-AbsoluteLimitsTests-672899650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7e69cebb-1b96-439f-8602-efbad3734e51 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:12 devstack sudo[94383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7e69cebb-1b96-439f-8602-efbad3734e51 Jul 06 15:32:12 devstack sudo[94383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:12 devstack sudo[94383]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ee1e7484-4f71-434b-ad24-f92b8b4ece33 tempest-AbsoluteLimitsTests-672899650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7e69cebb-1b96-439f-8602-efbad3734e51" returned: 0 in 0.837s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ee1e7484-4f71-434b-ad24-f92b8b4ece33 tempest-AbsoluteLimitsTests-672899650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7e69cebb-1b96-439f-8602-efbad3734e51 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:12 devstack sudo[94389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7e69cebb-1b96-439f-8602-efbad3734e51 Jul 06 15:32:12 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:13 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ee1e7484-4f71-434b-ad24-f92b8b4ece33 tempest-AbsoluteLimitsTests-672899650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7e69cebb-1b96-439f-8602-efbad3734e51" returned: 0 in 0.776s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:13 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ee1e7484-4f71-434b-ad24-f92b8b4ece33 tempest-AbsoluteLimitsTests-672899650 None] Lock "cinder-quobyte-7e69cebb-1b96-439f-8602-efbad3734e51" released by "delete_volume" :: held 1.658s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:13 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-ee1e7484-4f71-434b-ad24-f92b8b4ece33 tempest-AbsoluteLimitsTests-672899650 None] Created reservations ['097a07bf-b25e-4bad-9355-a1436b31d7af', '5c6f1f79-cae8-482a-95b9-0c20507bf2d3', 'd92be43d-0ba5-4d6c-b25a-2ae88ab8a7db', 'fd212888-ac30-4396-9f8a-9ffba36c7b80'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:32:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ee1e7484-4f71-434b-ad24-f92b8b4ece33 tempest-AbsoluteLimitsTests-672899650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ee1e7484-4f71-434b-ad24-f92b8b4ece33 tempest-AbsoluteLimitsTests-672899650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:13 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ee1e7484-4f71-434b-ad24-f92b8b4ece33 tempest-AbsoluteLimitsTests-672899650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:13 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ee1e7484-4f71-434b-ad24-f92b8b4ece33 tempest-AbsoluteLimitsTests-672899650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ee1e7484-4f71-434b-ad24-f92b8b4ece33 tempest-AbsoluteLimitsTests-672899650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ee1e7484-4f71-434b-ad24-f92b8b4ece33 tempest-AbsoluteLimitsTests-672899650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:13 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:32:13 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:14 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ee1e7484-4f71-434b-ad24-f92b8b4ece33 tempest-AbsoluteLimitsTests-672899650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.250s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:14 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-ee1e7484-4f71-434b-ad24-f92b8b4ece33 tempest-AbsoluteLimitsTests-672899650 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:32:14 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-ee1e7484-4f71-434b-ad24-f92b8b4ece33 tempest-AbsoluteLimitsTests-672899650 None] Deleted volume successfully. Jul 06 15:32:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ee1e7484-4f71-434b-ad24-f92b8b4ece33 tempest-AbsoluteLimitsTests-672899650 None] Lock "cinder-7e69cebb-1b96-439f-8602-efbad3734e51-delete_volume" released by "delete_volume" :: held 3.169s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:15 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-a285c437-c61e-47a6-9db7-d1481f4d9799 req-a29b2064-2f1a-4128-8201-21a2a909cc8f tempest-AttachVolumeTestJSON-1381247220 None] Terminate volume connection completed successfully. Jul 06 15:32:15 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-a285c437-c61e-47a6-9db7-d1481f4d9799 req-a29b2064-2f1a-4128-8201-21a2a909cc8f tempest-AttachVolumeTestJSON-1381247220 None] Deleting attachment 3c8c14c3-416d-4534-a818-8234f3294807. {{(pid=86148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:32:19 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-71206d97-bd42-4725-9076-d72ca1241eec req-a2c30efc-cc8d-44f8-8bb7-6627f106d623 tempest-AttachVolumeTestJSON-1381247220 None] Terminate volume connection completed successfully. Jul 06 15:32:19 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-71206d97-bd42-4725-9076-d72ca1241eec req-a2c30efc-cc8d-44f8-8bb7-6627f106d623 tempest-AttachVolumeTestJSON-1381247220 None] Deleting attachment e94531b2-4829-4950-858f-a23e660acd84. {{(pid=86148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:32:21 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:32:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Flow 'volume_create_manager' (55cd1c23-93f2-443c-9d30-e8f9d0de40b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:32:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8582e15d-ba69-42c4-b942-7b1944185686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8582e15d-ba69-42c4-b942-7b1944185686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1098916193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c969b754-05be-4a67-8b36-5e4a2555d826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e65d88a5f640669a45cd4c0bb49ea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:21Z,use_quota=True,user_id='9b0720753ea5413086875ce1066f14dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (982fd321-93fb-4cd5-9ef4-cea44b5a17f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (982fd321-93fb-4cd5-9ef4-cea44b5a17f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43316a4e-b637-43c5-b3f8-8a6546f86277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43316a4e-b637-43c5-b3f8-8a6546f86277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c969b754-05be-4a67-8b36-5e4a2555d826', 'volume_name': 'volume-c969b754-05be-4a67-8b36-5e4a2555d826', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f5302d-e30d-4083-bc1e-8a872cc8ff90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f5302d-e30d-4083-bc1e-8a872cc8ff90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f75c213-3f6b-4291-9bfe-69092200abb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:21 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Volume c969b754-05be-4a67-8b36-5e4a2555d826: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c969b754-05be-4a67-8b36-5e4a2555d826', 'volume_size': 1} Jul 06 15:32:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1098916193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c969b754-05be-4a67-8b36-5e4a2555d826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e65d88a5f640669a45cd4c0bb49ea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:21Z,use_quota=True,user_id='9b0720753ea5413086875ce1066f14dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:32:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Creating volume c969b754-05be-4a67-8b36-5e4a2555d826 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:32:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:32:21 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:32:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c969b754-05be-4a67-8b36-5e4a2555d826 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:21 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c969b754-05be-4a67-8b36-5e4a2555d826 1073741824 Jul 06 15:32:21 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:22 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c969b754-05be-4a67-8b36-5e4a2555d826 1073741824" returned: 0 in 1.249s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c969b754-05be-4a67-8b36-5e4a2555d826 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:22 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c969b754-05be-4a67-8b36-5e4a2555d826 Jul 06 15:32:22 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:23 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c969b754-05be-4a67-8b36-5e4a2555d826" returned: 0 in 0.781s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] <== create_volume: return (2094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:32:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.097s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f75c213-3f6b-4291-9bfe-69092200abb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c969b754-05be-4a67-8b36-5e4a2555d826', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b521751-9d03-4802-b882-32e4636f7e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:23 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Volume volume-c969b754-05be-4a67-8b36-5e4a2555d826 (c969b754-05be-4a67-8b36-5e4a2555d826): created successfully Jul 06 15:32:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b521751-9d03-4802-b882-32e4636f7e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Flow 'volume_create_manager' (55cd1c23-93f2-443c-9d30-e8f9d0de40b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:32:23 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-d50295f4-ebc4-4a4b-9e8c-f57fbd1551b5 tempest-VolumesMetadataTest-621015054 None] Created volume successfully. Jul 06 15:32:25 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f915b7c9-4a96-43bd-af9a-535ad2cf37b4 tempest-VolumesMetadataTest-621015054 None] Acquiring lock "cinder-c969b754-05be-4a67-8b36-5e4a2555d826-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:32:25 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f915b7c9-4a96-43bd-af9a-535ad2cf37b4 tempest-VolumesMetadataTest-621015054 None] Lock "cinder-c969b754-05be-4a67-8b36-5e4a2555d826-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:32:25 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f915b7c9-4a96-43bd-af9a-535ad2cf37b4 tempest-VolumesMetadataTest-621015054 None] Acquiring lock "cinder-quobyte-c969b754-05be-4a67-8b36-5e4a2555d826" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:32:25 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f915b7c9-4a96-43bd-af9a-535ad2cf37b4 tempest-VolumesMetadataTest-621015054 None] Lock "cinder-quobyte-c969b754-05be-4a67-8b36-5e4a2555d826" acquired by "delete_volume" :: waited 0.047s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:32:25 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d402f0-a6af-431b-8906-1a2aa4848283]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:32:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f915b7c9-4a96-43bd-af9a-535ad2cf37b4 tempest-VolumesMetadataTest-621015054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c969b754-05be-4a67-8b36-5e4a2555d826 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:26 devstack sudo[94501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c969b754-05be-4a67-8b36-5e4a2555d826 Jul 06 15:32:26 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:27 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f915b7c9-4a96-43bd-af9a-535ad2cf37b4 tempest-VolumesMetadataTest-621015054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c969b754-05be-4a67-8b36-5e4a2555d826" returned: 0 in 1.405s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f915b7c9-4a96-43bd-af9a-535ad2cf37b4 tempest-VolumesMetadataTest-621015054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c969b754-05be-4a67-8b36-5e4a2555d826 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:27 devstack sudo[94509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c969b754-05be-4a67-8b36-5e4a2555d826 Jul 06 15:32:27 devstack sudo[94509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:28 devstack sudo[94509]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f915b7c9-4a96-43bd-af9a-535ad2cf37b4 tempest-VolumesMetadataTest-621015054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c969b754-05be-4a67-8b36-5e4a2555d826" returned: 0 in 1.091s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:28 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f915b7c9-4a96-43bd-af9a-535ad2cf37b4 tempest-VolumesMetadataTest-621015054 None] Lock "cinder-quobyte-c969b754-05be-4a67-8b36-5e4a2555d826" released by "delete_volume" :: held 2.582s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:28 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:UPDATE=49,cinder:SELECT=54,cinder:INSERT=10,cinder:DELETE=6 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:32:28 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=58,cinder:UPDATE=58,cinder:INSERT=13,cinder:DELETE=4 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:32:28 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-f915b7c9-4a96-43bd-af9a-535ad2cf37b4 tempest-VolumesMetadataTest-621015054 None] Created reservations ['ca243cd2-7b56-46df-a026-916349cf8f44', 'f85209a7-ec69-43e6-b902-1a5db7d9bfe0', 'd63a44c5-60ef-4a18-acd4-2b7e87c6df86', '1731881d-ad96-4c8f-840b-13041a009782'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:32:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f915b7c9-4a96-43bd-af9a-535ad2cf37b4 tempest-VolumesMetadataTest-621015054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f915b7c9-4a96-43bd-af9a-535ad2cf37b4 tempest-VolumesMetadataTest-621015054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:28 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f915b7c9-4a96-43bd-af9a-535ad2cf37b4 tempest-VolumesMetadataTest-621015054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:28 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f915b7c9-4a96-43bd-af9a-535ad2cf37b4 tempest-VolumesMetadataTest-621015054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f915b7c9-4a96-43bd-af9a-535ad2cf37b4 tempest-VolumesMetadataTest-621015054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f915b7c9-4a96-43bd-af9a-535ad2cf37b4 tempest-VolumesMetadataTest-621015054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:28 devstack sudo[94513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:32:28 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f915b7c9-4a96-43bd-af9a-535ad2cf37b4 tempest-VolumesMetadataTest-621015054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.994s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:29 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-f915b7c9-4a96-43bd-af9a-535ad2cf37b4 tempest-VolumesMetadataTest-621015054 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:32:29 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-f915b7c9-4a96-43bd-af9a-535ad2cf37b4 tempest-VolumesMetadataTest-621015054 None] Deleted volume successfully. Jul 06 15:32:29 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f915b7c9-4a96-43bd-af9a-535ad2cf37b4 tempest-VolumesMetadataTest-621015054 None] Lock "cinder-c969b754-05be-4a67-8b36-5e4a2555d826-delete_volume" released by "delete_volume" :: held 3.965s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Flow 'volume_create_manager' (eab55709-d362-4185-812d-44c9c00a1e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (252d7abd-6575-44a2-917c-38ad4d529700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (252d7abd-6575-44a2-917c-38ad4d529700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-941085406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2a3019a-7e8a-481e-a4e3-775d4df59a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='971bf995f0a042e49344d7ca1296ec39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:32Z,use_quota=True,user_id='2e6e1855a9d0499dbaf10266858753e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93651390-7832-4da9-99e0-f0797a703077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93651390-7832-4da9-99e0-f0797a703077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c46bdba2-457f-4b6c-b9a1-987fb15c0171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c46bdba2-457f-4b6c-b9a1-987fb15c0171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2a3019a-7e8a-481e-a4e3-775d4df59a99', 'volume_name': 'volume-a2a3019a-7e8a-481e-a4e3-775d4df59a99', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd2f14c9-fecf-4137-816e-cd08773777eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd2f14c9-fecf-4137-816e-cd08773777eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb5487c2-e931-4ed8-ad80-13df1ecb67ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:32 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Volume a2a3019a-7e8a-481e-a4e3-775d4df59a99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2a3019a-7e8a-481e-a4e3-775d4df59a99', 'volume_size': 1} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-941085406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2a3019a-7e8a-481e-a4e3-775d4df59a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='971bf995f0a042e49344d7ca1296ec39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:32Z,use_quota=True,user_id='2e6e1855a9d0499dbaf10266858753e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Creating volume a2a3019a-7e8a-481e-a4e3-775d4df59a99 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:32:32 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a2a3019a-7e8a-481e-a4e3-775d4df59a99 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:32 devstack sudo[94552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a2a3019a-7e8a-481e-a4e3-775d4df59a99 1073741824 Jul 06 15:32:32 devstack sudo[94552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-acb5c2b2-e976-44b2-a313-3b0ed67fb538 tempest-AttachVolumeTestJSON-1381247220 None] Acquiring lock "cinder-c986d6ac-a9fe-490c-a669-526ca9b6d453-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-acb5c2b2-e976-44b2-a313-3b0ed67fb538 tempest-AttachVolumeTestJSON-1381247220 None] Lock "cinder-c986d6ac-a9fe-490c-a669-526ca9b6d453-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Flow 'volume_create_manager' (c2101023-137c-4fd5-9fb4-2ee2da10ee2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76263119-6485-46f0-87ab-71a66630ebf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76263119-6485-46f0-87ab-71a66630ebf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1826783528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14336ae6-5e39-4123-9de6-9cfafd231a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='971bf995f0a042e49344d7ca1296ec39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:33Z,use_quota=True,user_id='2e6e1855a9d0499dbaf10266858753e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (334fe7af-e27e-4191-909f-7d72aaca837a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (334fe7af-e27e-4191-909f-7d72aaca837a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66eefc3c-c9f5-4502-9131-98dca0278cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66eefc3c-c9f5-4502-9131-98dca0278cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14336ae6-5e39-4123-9de6-9cfafd231a05', 'volume_name': 'volume-14336ae6-5e39-4123-9de6-9cfafd231a05', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1201268f-1ff5-4b71-b26d-24e13b81d5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1201268f-1ff5-4b71-b26d-24e13b81d5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a477a9e4-4520-4f63-ad6d-f73b1d174559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:32 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Volume 14336ae6-5e39-4123-9de6-9cfafd231a05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14336ae6-5e39-4123-9de6-9cfafd231a05', 'volume_size': 1} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-acb5c2b2-e976-44b2-a313-3b0ed67fb538 tempest-AttachVolumeTestJSON-1381247220 None] Acquiring lock "cinder-quobyte-c986d6ac-a9fe-490c-a669-526ca9b6d453" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:32:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-acb5c2b2-e976-44b2-a313-3b0ed67fb538 tempest-AttachVolumeTestJSON-1381247220 None] Lock "cinder-quobyte-c986d6ac-a9fe-490c-a669-526ca9b6d453" acquired by "delete_volume" :: waited 0.020s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:32:33 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[14088008-1a9a-4b5c-a81c-f6be87702ac5]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:32:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-acb5c2b2-e976-44b2-a313-3b0ed67fb538 tempest-AttachVolumeTestJSON-1381247220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c986d6ac-a9fe-490c-a669-526ca9b6d453 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:33 devstack sudo[94554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c986d6ac-a9fe-490c-a669-526ca9b6d453 Jul 06 15:32:33 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:33 devstack sudo[94552]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a2a3019a-7e8a-481e-a4e3-775d4df59a99 1073741824" returned: 0 in 1.250s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a2a3019a-7e8a-481e-a4e3-775d4df59a99 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:33 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a2a3019a-7e8a-481e-a4e3-775d4df59a99 Jul 06 15:32:33 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:34 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-acb5c2b2-e976-44b2-a313-3b0ed67fb538 tempest-AttachVolumeTestJSON-1381247220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c986d6ac-a9fe-490c-a669-526ca9b6d453" returned: 0 in 1.081s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-acb5c2b2-e976-44b2-a313-3b0ed67fb538 tempest-AttachVolumeTestJSON-1381247220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c986d6ac-a9fe-490c-a669-526ca9b6d453 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:34 devstack sudo[94566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c986d6ac-a9fe-490c-a669-526ca9b6d453 Jul 06 15:32:34 devstack sudo[94566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:34 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a2a3019a-7e8a-481e-a4e3-775d4df59a99" returned: 0 in 1.044s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] <== create_volume: return (2360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:32:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.366s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.898s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1826783528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14336ae6-5e39-4123-9de6-9cfafd231a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='971bf995f0a042e49344d7ca1296ec39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:33Z,use_quota=True,user_id='2e6e1855a9d0499dbaf10266858753e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:32:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Creating volume 14336ae6-5e39-4123-9de6-9cfafd231a05 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:32:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:32:34 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:32:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-14336ae6-5e39-4123-9de6-9cfafd231a05 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:34 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-14336ae6-5e39-4123-9de6-9cfafd231a05 1073741824 Jul 06 15:32:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb5487c2-e931-4ed8-ad80-13df1ecb67ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2a3019a-7e8a-481e-a4e3-775d4df59a99', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:34 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f72afaff-e412-4149-90e9-4dad7f5eb784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:34 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Volume volume-a2a3019a-7e8a-481e-a4e3-775d4df59a99 (a2a3019a-7e8a-481e-a4e3-775d4df59a99): created successfully Jul 06 15:32:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f72afaff-e412-4149-90e9-4dad7f5eb784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Flow 'volume_create_manager' (eab55709-d362-4185-812d-44c9c00a1e2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:32:34 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-d468e4da-3d49-44dd-a1c1-ea8708623c21 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Created volume successfully. Jul 06 15:32:35 devstack sudo[94566]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-acb5c2b2-e976-44b2-a313-3b0ed67fb538 tempest-AttachVolumeTestJSON-1381247220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c986d6ac-a9fe-490c-a669-526ca9b6d453" returned: 0 in 0.934s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-acb5c2b2-e976-44b2-a313-3b0ed67fb538 tempest-AttachVolumeTestJSON-1381247220 None] Lock "cinder-quobyte-c986d6ac-a9fe-490c-a669-526ca9b6d453" released by "delete_volume" :: held 2.085s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:35 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-acb5c2b2-e976-44b2-a313-3b0ed67fb538 tempest-AttachVolumeTestJSON-1381247220 None] Created reservations ['6550dc3a-b3f0-4be8-a1ca-fbd3b86607ad', '3716616c-90f5-4999-aa46-68fbb00dd89c', '3289473d-1d95-4aca-af2d-5bc3cfe50edd', '0254f648-6207-4adc-ab3a-f8c33c6507b4'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:32:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-acb5c2b2-e976-44b2-a313-3b0ed67fb538 tempest-AttachVolumeTestJSON-1381247220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-acb5c2b2-e976-44b2-a313-3b0ed67fb538 tempest-AttachVolumeTestJSON-1381247220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:35 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-acb5c2b2-e976-44b2-a313-3b0ed67fb538 tempest-AttachVolumeTestJSON-1381247220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:35 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-acb5c2b2-e976-44b2-a313-3b0ed67fb538 tempest-AttachVolumeTestJSON-1381247220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-acb5c2b2-e976-44b2-a313-3b0ed67fb538 tempest-AttachVolumeTestJSON-1381247220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-acb5c2b2-e976-44b2-a313-3b0ed67fb538 tempest-AttachVolumeTestJSON-1381247220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:35 devstack sudo[94608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:32:35 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:35 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:32:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Flow 'volume_create_manager' (f9daf22f-1651-46c2-a890-bca478af12d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:32:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b7f1be-c64c-42a3-b57b-9e9ba73a1dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b7f1be-c64c-42a3-b57b-9e9ba73a1dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2029886157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b3d5079-ae71-4316-9878-e996ea8d7038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5aab69eade74481977889fa2c325733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:36Z,use_quota=True,user_id='31051c61e2f34d18bc6c23d539ebe961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a8d621-cac2-410f-9461-0a58ab31d4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a8d621-cac2-410f-9461-0a58ab31d4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d6ee16-c552-4603-9c2d-b0542b71d198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d6ee16-c552-4603-9c2d-b0542b71d198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b3d5079-ae71-4316-9878-e996ea8d7038', 'volume_name': 'volume-3b3d5079-ae71-4316-9878-e996ea8d7038', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e43d9d-a7bb-41f1-89f7-f2cf7e902012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e43d9d-a7bb-41f1-89f7-f2cf7e902012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40fc306d-0800-4cd8-b2d7-e1a5652d661f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:36 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Volume 3b3d5079-ae71-4316-9878-e996ea8d7038: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b3d5079-ae71-4316-9878-e996ea8d7038', 'volume_size': 1} Jul 06 15:32:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:36 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-acb5c2b2-e976-44b2-a313-3b0ed67fb538 tempest-AttachVolumeTestJSON-1381247220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.962s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:36 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-acb5c2b2-e976-44b2-a313-3b0ed67fb538 tempest-AttachVolumeTestJSON-1381247220 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:32:36 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-acb5c2b2-e976-44b2-a313-3b0ed67fb538 tempest-AttachVolumeTestJSON-1381247220 None] Deleted volume successfully. Jul 06 15:32:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-acb5c2b2-e976-44b2-a313-3b0ed67fb538 tempest-AttachVolumeTestJSON-1381247220 None] Lock "cinder-c986d6ac-a9fe-490c-a669-526ca9b6d453-delete_volume" released by "delete_volume" :: held 3.384s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:36 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b14a525e-7088-4da0-a11c-3d3fcf3ce5bf tempest-AttachVolumeTestJSON-1381247220 None] Acquiring lock "cinder-4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:32:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-14336ae6-5e39-4123-9de6-9cfafd231a05 1073741824" returned: 0 in 1.400s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b14a525e-7088-4da0-a11c-3d3fcf3ce5bf tempest-AttachVolumeTestJSON-1381247220 None] Lock "cinder-4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:32:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-14336ae6-5e39-4123-9de6-9cfafd231a05 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b14a525e-7088-4da0-a11c-3d3fcf3ce5bf tempest-AttachVolumeTestJSON-1381247220 None] Acquiring lock "cinder-quobyte-4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:32:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b14a525e-7088-4da0-a11c-3d3fcf3ce5bf tempest-AttachVolumeTestJSON-1381247220 None] Lock "cinder-quobyte-4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d" acquired by "delete_volume" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:32:36 devstack sudo[94615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-14336ae6-5e39-4123-9de6-9cfafd231a05 Jul 06 15:32:36 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:36 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d399cb4-9c6c-42bd-a7fe-c15cf688dfd1]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:32:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b14a525e-7088-4da0-a11c-3d3fcf3ce5bf tempest-AttachVolumeTestJSON-1381247220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:36 devstack sudo[94617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d Jul 06 15:32:36 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:37 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-14336ae6-5e39-4123-9de6-9cfafd231a05" returned: 0 in 0.799s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] <== create_volume: return (2264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:32:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.268s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.072s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2029886157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b3d5079-ae71-4316-9878-e996ea8d7038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5aab69eade74481977889fa2c325733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:36Z,use_quota=True,user_id='31051c61e2f34d18bc6c23d539ebe961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:32:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Creating volume 3b3d5079-ae71-4316-9878-e996ea8d7038 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:32:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:32:37 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:32:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b3d5079-ae71-4316-9878-e996ea8d7038 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:37 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a477a9e4-4520-4f63-ad6d-f73b1d174559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14336ae6-5e39-4123-9de6-9cfafd231a05', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:37 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e78c1e31-e93b-4036-b8fa-f1816b7f1450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:37 devstack sudo[94625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b3d5079-ae71-4316-9878-e996ea8d7038 1073741824 Jul 06 15:32:37 devstack sudo[94625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:37 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Volume volume-14336ae6-5e39-4123-9de6-9cfafd231a05 (14336ae6-5e39-4123-9de6-9cfafd231a05): created successfully Jul 06 15:32:37 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e78c1e31-e93b-4036-b8fa-f1816b7f1450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:37 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Flow 'volume_create_manager' (c2101023-137c-4fd5-9fb4-2ee2da10ee2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:32:37 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-dc988ee7-8d49-4415-a57c-222fab8a752c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Created volume successfully. Jul 06 15:32:37 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b14a525e-7088-4da0-a11c-3d3fcf3ce5bf tempest-AttachVolumeTestJSON-1381247220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d" returned: 0 in 0.981s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b14a525e-7088-4da0-a11c-3d3fcf3ce5bf tempest-AttachVolumeTestJSON-1381247220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:37 devstack sudo[94630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d Jul 06 15:32:37 devstack sudo[94630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:38 devstack sudo[94630]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b14a525e-7088-4da0-a11c-3d3fcf3ce5bf tempest-AttachVolumeTestJSON-1381247220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d" returned: 0 in 0.744s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b14a525e-7088-4da0-a11c-3d3fcf3ce5bf tempest-AttachVolumeTestJSON-1381247220 None] Lock "cinder-quobyte-4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d" released by "delete_volume" :: held 1.787s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:38 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-b14a525e-7088-4da0-a11c-3d3fcf3ce5bf tempest-AttachVolumeTestJSON-1381247220 None] Created reservations ['61752cee-2740-460f-874d-497e6099cb39', '4cd55bc9-ede3-42ab-be73-f84f4b9a481e', 'fc6ee0cc-462b-4fae-a763-b0e01ed0d5e2', '536530e7-ad24-4492-bb17-13e8d4149865'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:32:38 devstack sudo[94625]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b3d5079-ae71-4316-9878-e996ea8d7038 1073741824" returned: 0 in 1.102s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b3d5079-ae71-4316-9878-e996ea8d7038 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:38 devstack sudo[94638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b3d5079-ae71-4316-9878-e996ea8d7038 Jul 06 15:32:38 devstack sudo[94638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b14a525e-7088-4da0-a11c-3d3fcf3ce5bf tempest-AttachVolumeTestJSON-1381247220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b14a525e-7088-4da0-a11c-3d3fcf3ce5bf tempest-AttachVolumeTestJSON-1381247220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b14a525e-7088-4da0-a11c-3d3fcf3ce5bf tempest-AttachVolumeTestJSON-1381247220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b14a525e-7088-4da0-a11c-3d3fcf3ce5bf tempest-AttachVolumeTestJSON-1381247220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b14a525e-7088-4da0-a11c-3d3fcf3ce5bf tempest-AttachVolumeTestJSON-1381247220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b14a525e-7088-4da0-a11c-3d3fcf3ce5bf tempest-AttachVolumeTestJSON-1381247220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:38 devstack sudo[94640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:32:38 devstack sudo[94640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:32:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:38 devstack sudo[94643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:32:38 devstack sudo[94643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b0524478-8eb2-4755-a61f-e415c0d1def7 tempest-AttachVolumeTestJSON-1381247220 None] Acquiring lock "cinder-0eae0954-68cf-4529-8ee5-8ab4a0761de5-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:32:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b0524478-8eb2-4755-a61f-e415c0d1def7 tempest-AttachVolumeTestJSON-1381247220 None] Lock "cinder-0eae0954-68cf-4529-8ee5-8ab4a0761de5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:32:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b0524478-8eb2-4755-a61f-e415c0d1def7 tempest-AttachVolumeTestJSON-1381247220 None] Acquiring lock "cinder-quobyte-0eae0954-68cf-4529-8ee5-8ab4a0761de5" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:32:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b0524478-8eb2-4755-a61f-e415c0d1def7 tempest-AttachVolumeTestJSON-1381247220 None] Lock "cinder-quobyte-0eae0954-68cf-4529-8ee5-8ab4a0761de5" acquired by "delete_volume" :: waited 0.031s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:32:38 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[af48bbb6-1258-4ab3-8a14-ea4dca53789e]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:32:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b0524478-8eb2-4755-a61f-e415c0d1def7 tempest-AttachVolumeTestJSON-1381247220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0eae0954-68cf-4529-8ee5-8ab4a0761de5 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:39 devstack sudo[94645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0eae0954-68cf-4529-8ee5-8ab4a0761de5 Jul 06 15:32:39 devstack sudo[94638]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:39 devstack sudo[94645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b3d5079-ae71-4316-9878-e996ea8d7038" returned: 0 in 0.740s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:39 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:32:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.908s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40fc306d-0800-4cd8-b2d7-e1a5652d661f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b3d5079-ae71-4316-9878-e996ea8d7038', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4903aaa9-04ee-4b0e-9ec4-4e001e603f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:39 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Volume volume-3b3d5079-ae71-4316-9878-e996ea8d7038 (3b3d5079-ae71-4316-9878-e996ea8d7038): created successfully Jul 06 15:32:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4903aaa9-04ee-4b0e-9ec4-4e001e603f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Flow 'volume_create_manager' (f9daf22f-1651-46c2-a890-bca478af12d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:32:39 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-34f84c7e-1c9c-4afe-882c-40ec952712bf tempest-VolumesTransfersV355Test-1843086127 None] Created volume successfully. Jul 06 15:32:39 devstack sudo[94640]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b14a525e-7088-4da0-a11c-3d3fcf3ce5bf tempest-AttachVolumeTestJSON-1381247220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.789s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-b14a525e-7088-4da0-a11c-3d3fcf3ce5bf tempest-AttachVolumeTestJSON-1381247220 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:32:39 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-b14a525e-7088-4da0-a11c-3d3fcf3ce5bf tempest-AttachVolumeTestJSON-1381247220 None] Deleted volume successfully. Jul 06 15:32:39 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b14a525e-7088-4da0-a11c-3d3fcf3ce5bf tempest-AttachVolumeTestJSON-1381247220 None] Lock "cinder-4c0a3dbb-4ce1-498a-8012-4f2cf0d73a8d-delete_volume" released by "delete_volume" :: held 2.873s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:39 devstack sudo[94643]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.876s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:32:39 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager._thread_info {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:32:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread count: 28 {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:32:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread info: [<_MainThread(MainThread, started 124857273856128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:32:39 devstack sudo[94645]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b0524478-8eb2-4755-a61f-e415c0d1def7 tempest-AttachVolumeTestJSON-1381247220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0eae0954-68cf-4529-8ee5-8ab4a0761de5" returned: 0 in 0.800s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b0524478-8eb2-4755-a61f-e415c0d1def7 tempest-AttachVolumeTestJSON-1381247220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0eae0954-68cf-4529-8ee5-8ab4a0761de5 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:39 devstack sudo[94653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0eae0954-68cf-4529-8ee5-8ab4a0761de5 Jul 06 15:32:39 devstack sudo[94653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:40 devstack sudo[94653]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b0524478-8eb2-4755-a61f-e415c0d1def7 tempest-AttachVolumeTestJSON-1381247220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0eae0954-68cf-4529-8ee5-8ab4a0761de5" returned: 0 in 0.702s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:40 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b0524478-8eb2-4755-a61f-e415c0d1def7 tempest-AttachVolumeTestJSON-1381247220 None] Lock "cinder-quobyte-0eae0954-68cf-4529-8ee5-8ab4a0761de5" released by "delete_volume" :: held 1.573s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:40 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-b0524478-8eb2-4755-a61f-e415c0d1def7 tempest-AttachVolumeTestJSON-1381247220 None] Created reservations ['03bcc7f4-0aeb-4b68-8388-fc97741958e6', 'e35a86d8-c8c8-41e5-b7a6-a2a5f6c8f0ec', '5081b46d-a444-4b19-b003-6700e0291af5', '5b7a1cfe-89a4-4d4c-81cd-e0c8b2dda7e9'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:32:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b0524478-8eb2-4755-a61f-e415c0d1def7 tempest-AttachVolumeTestJSON-1381247220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b0524478-8eb2-4755-a61f-e415c0d1def7 tempest-AttachVolumeTestJSON-1381247220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b0524478-8eb2-4755-a61f-e415c0d1def7 tempest-AttachVolumeTestJSON-1381247220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b0524478-8eb2-4755-a61f-e415c0d1def7 tempest-AttachVolumeTestJSON-1381247220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b0524478-8eb2-4755-a61f-e415c0d1def7 tempest-AttachVolumeTestJSON-1381247220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b0524478-8eb2-4755-a61f-e415c0d1def7 tempest-AttachVolumeTestJSON-1381247220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:40 devstack sudo[94656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:32:40 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:40 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-5055e633-907c-45e3-a557-3b5fd5fc7b29 tempest-VolumesTransfersV355Test-1217142952 None] Transfer volume completed successfully. Jul 06 15:32:41 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b0524478-8eb2-4755-a61f-e415c0d1def7 tempest-AttachVolumeTestJSON-1381247220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.706s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:41 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-b0524478-8eb2-4755-a61f-e415c0d1def7 tempest-AttachVolumeTestJSON-1381247220 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:32:41 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-b0524478-8eb2-4755-a61f-e415c0d1def7 tempest-AttachVolumeTestJSON-1381247220 None] Deleted volume successfully. Jul 06 15:32:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b0524478-8eb2-4755-a61f-e415c0d1def7 tempest-AttachVolumeTestJSON-1381247220 None] Lock "cinder-0eae0954-68cf-4529-8ee5-8ab4a0761de5-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c6408134-6526-4c32-a7b3-eceb098e95e9 tempest-VolumesTransfersV355Test-1533272831 None] Acquiring lock "cinder-3b3d5079-ae71-4316-9878-e996ea8d7038-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:32:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c6408134-6526-4c32-a7b3-eceb098e95e9 tempest-VolumesTransfersV355Test-1533272831 None] Lock "cinder-3b3d5079-ae71-4316-9878-e996ea8d7038-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:32:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c6408134-6526-4c32-a7b3-eceb098e95e9 tempest-VolumesTransfersV355Test-1533272831 None] Acquiring lock "cinder-quobyte-3b3d5079-ae71-4316-9878-e996ea8d7038" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:32:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c6408134-6526-4c32-a7b3-eceb098e95e9 tempest-VolumesTransfersV355Test-1533272831 None] Lock "cinder-quobyte-3b3d5079-ae71-4316-9878-e996ea8d7038" acquired by "delete_volume" :: waited 0.024s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:32:41 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[917152b1-4ea9-410e-a414-37c87fd0b274]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:32:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c6408134-6526-4c32-a7b3-eceb098e95e9 tempest-VolumesTransfersV355Test-1533272831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b3d5079-ae71-4316-9878-e996ea8d7038 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:42 devstack sudo[94661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b3d5079-ae71-4316-9878-e996ea8d7038 Jul 06 15:32:42 devstack sudo[94661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:43 devstack sudo[94661]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c6408134-6526-4c32-a7b3-eceb098e95e9 tempest-VolumesTransfersV355Test-1533272831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b3d5079-ae71-4316-9878-e996ea8d7038" returned: 0 in 1.197s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c6408134-6526-4c32-a7b3-eceb098e95e9 tempest-VolumesTransfersV355Test-1533272831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b3d5079-ae71-4316-9878-e996ea8d7038 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:43 devstack sudo[94668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b3d5079-ae71-4316-9878-e996ea8d7038 Jul 06 15:32:43 devstack sudo[94668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:43 devstack sudo[94668]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c6408134-6526-4c32-a7b3-eceb098e95e9 tempest-VolumesTransfersV355Test-1533272831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b3d5079-ae71-4316-9878-e996ea8d7038" returned: 0 in 0.819s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c6408134-6526-4c32-a7b3-eceb098e95e9 tempest-VolumesTransfersV355Test-1533272831 None] Lock "cinder-quobyte-3b3d5079-ae71-4316-9878-e996ea8d7038" released by "delete_volume" :: held 2.078s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:44 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-c6408134-6526-4c32-a7b3-eceb098e95e9 tempest-VolumesTransfersV355Test-1533272831 None] Created reservations ['767a748e-e8c8-41c2-9d11-1fcaeed78e47', 'd5d91d53-89a3-405f-96ef-56063ce7c38f', '2c2d93ad-8911-4627-84c8-e981fa88a4c4', '91674b89-83c3-41c1-b7cd-e94874b281f7'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:32:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c6408134-6526-4c32-a7b3-eceb098e95e9 tempest-VolumesTransfersV355Test-1533272831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c6408134-6526-4c32-a7b3-eceb098e95e9 tempest-VolumesTransfersV355Test-1533272831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c6408134-6526-4c32-a7b3-eceb098e95e9 tempest-VolumesTransfersV355Test-1533272831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c6408134-6526-4c32-a7b3-eceb098e95e9 tempest-VolumesTransfersV355Test-1533272831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c6408134-6526-4c32-a7b3-eceb098e95e9 tempest-VolumesTransfersV355Test-1533272831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c6408134-6526-4c32-a7b3-eceb098e95e9 tempest-VolumesTransfersV355Test-1533272831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:44 devstack sudo[94700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:32:44 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:45 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c6408134-6526-4c32-a7b3-eceb098e95e9 tempest-VolumesTransfersV355Test-1533272831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.911s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:45 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-c6408134-6526-4c32-a7b3-eceb098e95e9 tempest-VolumesTransfersV355Test-1533272831 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:32:45 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-c6408134-6526-4c32-a7b3-eceb098e95e9 tempest-VolumesTransfersV355Test-1533272831 None] Deleted volume successfully. Jul 06 15:32:45 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c6408134-6526-4c32-a7b3-eceb098e95e9 tempest-VolumesTransfersV355Test-1533272831 None] Lock "cinder-3b3d5079-ae71-4316-9878-e996ea8d7038-delete_volume" released by "delete_volume" :: held 3.387s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:45 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:32:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Flow 'volume_create_manager' (f5d3463b-fa64-4241-9f94-c42dc547d48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:32:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17bc650d-9589-4de0-b141-36e7e126905b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17bc650d-9589-4de0-b141-36e7e126905b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-827151895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac14b3c0-5e21-4c17-a8b0-b66904ba6f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5aab69eade74481977889fa2c325733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:46Z,use_quota=True,user_id='31051c61e2f34d18bc6c23d539ebe961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63fec569-08f1-4d64-8734-72964d314d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63fec569-08f1-4d64-8734-72964d314d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a4b251-4c9f-46ec-b70a-751cbbe12212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a4b251-4c9f-46ec-b70a-751cbbe12212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac14b3c0-5e21-4c17-a8b0-b66904ba6f6b', 'volume_name': 'volume-ac14b3c0-5e21-4c17-a8b0-b66904ba6f6b', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ddeb952-2a71-473d-bf8d-7abce350f721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ddeb952-2a71-473d-bf8d-7abce350f721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb6f38b2-7de5-4cbc-89d0-77047d4907c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:46 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Volume ac14b3c0-5e21-4c17-a8b0-b66904ba6f6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac14b3c0-5e21-4c17-a8b0-b66904ba6f6b', 'volume_size': 1} Jul 06 15:32:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-827151895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac14b3c0-5e21-4c17-a8b0-b66904ba6f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5aab69eade74481977889fa2c325733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:46Z,use_quota=True,user_id='31051c61e2f34d18bc6c23d539ebe961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:32:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Creating volume ac14b3c0-5e21-4c17-a8b0-b66904ba6f6b {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:32:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:32:46 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:32:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ac14b3c0-5e21-4c17-a8b0-b66904ba6f6b 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:46 devstack sudo[94717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ac14b3c0-5e21-4c17-a8b0-b66904ba6f6b 1073741824 Jul 06 15:32:46 devstack sudo[94717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:47 devstack sudo[94717]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ac14b3c0-5e21-4c17-a8b0-b66904ba6f6b 1073741824" returned: 0 in 1.225s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ac14b3c0-5e21-4c17-a8b0-b66904ba6f6b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:47 devstack sudo[94726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ac14b3c0-5e21-4c17-a8b0-b66904ba6f6b Jul 06 15:32:47 devstack sudo[94726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:48 devstack sudo[94726]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ac14b3c0-5e21-4c17-a8b0-b66904ba6f6b" returned: 0 in 0.779s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:48 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] <== create_volume: return (2049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:32:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.052s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb6f38b2-7de5-4cbc-89d0-77047d4907c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac14b3c0-5e21-4c17-a8b0-b66904ba6f6b', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4437a6-3d70-4d3c-b33c-6f6eba725e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:48 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Volume volume-ac14b3c0-5e21-4c17-a8b0-b66904ba6f6b (ac14b3c0-5e21-4c17-a8b0-b66904ba6f6b): created successfully Jul 06 15:32:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4437a6-3d70-4d3c-b33c-6f6eba725e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Flow 'volume_create_manager' (f5d3463b-fa64-4241-9f94-c42dc547d48f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:32:48 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-dcabf465-0185-452f-bfbe-b8382638fb17 tempest-VolumesTransfersV355Test-1843086127 None] Created volume successfully. Jul 06 15:32:49 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-148d9981-c3e0-4aa5-9ac9-ec22ee8cad1d tempest-VolumesTransfersV355Test-1533272831 None] Acquiring lock "cinder-ac14b3c0-5e21-4c17-a8b0-b66904ba6f6b-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:32:49 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-148d9981-c3e0-4aa5-9ac9-ec22ee8cad1d tempest-VolumesTransfersV355Test-1533272831 None] Lock "cinder-ac14b3c0-5e21-4c17-a8b0-b66904ba6f6b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:32:49 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-148d9981-c3e0-4aa5-9ac9-ec22ee8cad1d tempest-VolumesTransfersV355Test-1533272831 None] Acquiring lock "cinder-quobyte-ac14b3c0-5e21-4c17-a8b0-b66904ba6f6b" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:32:49 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-148d9981-c3e0-4aa5-9ac9-ec22ee8cad1d tempest-VolumesTransfersV355Test-1533272831 None] Lock "cinder-quobyte-ac14b3c0-5e21-4c17-a8b0-b66904ba6f6b" acquired by "delete_volume" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:32:50 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[89616a58-1ba1-45bc-a58b-de9b98163de6]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:32:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-148d9981-c3e0-4aa5-9ac9-ec22ee8cad1d tempest-VolumesTransfersV355Test-1533272831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ac14b3c0-5e21-4c17-a8b0-b66904ba6f6b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:50 devstack sudo[94776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ac14b3c0-5e21-4c17-a8b0-b66904ba6f6b Jul 06 15:32:50 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:50 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-148d9981-c3e0-4aa5-9ac9-ec22ee8cad1d tempest-VolumesTransfersV355Test-1533272831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ac14b3c0-5e21-4c17-a8b0-b66904ba6f6b" returned: 0 in 0.952s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-148d9981-c3e0-4aa5-9ac9-ec22ee8cad1d tempest-VolumesTransfersV355Test-1533272831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ac14b3c0-5e21-4c17-a8b0-b66904ba6f6b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:50 devstack sudo[94803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ac14b3c0-5e21-4c17-a8b0-b66904ba6f6b Jul 06 15:32:50 devstack sudo[94803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:51 devstack sudo[94803]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-148d9981-c3e0-4aa5-9ac9-ec22ee8cad1d tempest-VolumesTransfersV355Test-1533272831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ac14b3c0-5e21-4c17-a8b0-b66904ba6f6b" returned: 0 in 1.012s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:52 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-148d9981-c3e0-4aa5-9ac9-ec22ee8cad1d tempest-VolumesTransfersV355Test-1533272831 None] Lock "cinder-quobyte-ac14b3c0-5e21-4c17-a8b0-b66904ba6f6b" released by "delete_volume" :: held 2.030s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:52 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-40f250ed-6490-492e-a0ee-0388240febbd tempest-GroupSnapshotsV319Test-1876811479 None] Group tempest-GroupSnapshotsV319Test-Group-436941700: creating Jul 06 15:32:52 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-148d9981-c3e0-4aa5-9ac9-ec22ee8cad1d tempest-VolumesTransfersV355Test-1533272831 None] Created reservations ['131a286a-b3e0-4883-8ec7-5f6df4e9ca3c', '312dcdd6-2a7f-4d14-81d2-e4e4635f6a63', 'e4c9533d-b4ab-4767-9de5-84e42d4ff7f0', '5ea61609-e6c3-4c8d-a2b8-9aac5047af80'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:32:52 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-40f250ed-6490-492e-a0ee-0388240febbd tempest-GroupSnapshotsV319Test-1876811479 None] Group tempest-GroupSnapshotsV319Test-Group-436941700: created successfully Jul 06 15:32:52 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-40f250ed-6490-492e-a0ee-0388240febbd tempest-GroupSnapshotsV319Test-1876811479 None] Create group completed successfully. Jul 06 15:32:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-148d9981-c3e0-4aa5-9ac9-ec22ee8cad1d tempest-VolumesTransfersV355Test-1533272831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-148d9981-c3e0-4aa5-9ac9-ec22ee8cad1d tempest-VolumesTransfersV355Test-1533272831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:52 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-148d9981-c3e0-4aa5-9ac9-ec22ee8cad1d tempest-VolumesTransfersV355Test-1533272831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:52 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-148d9981-c3e0-4aa5-9ac9-ec22ee8cad1d tempest-VolumesTransfersV355Test-1533272831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-148d9981-c3e0-4aa5-9ac9-ec22ee8cad1d tempest-VolumesTransfersV355Test-1533272831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-148d9981-c3e0-4aa5-9ac9-ec22ee8cad1d tempest-VolumesTransfersV355Test-1533272831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:52 devstack sudo[94828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:32:52 devstack sudo[94828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:53 devstack sudo[94828]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-148d9981-c3e0-4aa5-9ac9-ec22ee8cad1d tempest-VolumesTransfersV355Test-1533272831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.980s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:53 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-148d9981-c3e0-4aa5-9ac9-ec22ee8cad1d tempest-VolumesTransfersV355Test-1533272831 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:32:53 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-148d9981-c3e0-4aa5-9ac9-ec22ee8cad1d tempest-VolumesTransfersV355Test-1533272831 None] Deleted volume successfully. Jul 06 15:32:53 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-148d9981-c3e0-4aa5-9ac9-ec22ee8cad1d tempest-VolumesTransfersV355Test-1533272831 None] Lock "cinder-ac14b3c0-5e21-4c17-a8b0-b66904ba6f6b-delete_volume" released by "delete_volume" :: held 3.589s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:54 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:32:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Flow 'volume_create_manager' (273b31ba-f193-4f3e-9413-3d842c467cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:32:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37da3284-5911-4fc9-94ed-137a186595de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37da3284-5911-4fc9-94ed-137a186595de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2030454583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=89940787-d1a9-4a9a-a2e1-295b2599b6ca,host='devstack@QuobyteHD#QuobyteHD',id=19ddb419-37b8-43d4-966a-b3f4239bb974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4c8b5a32f704219a83d942fe04dd90e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:54Z,use_quota=True,user_id='42de5d683a2e412fae7837946f77aaeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d17b6973-2060-4d33-ac14-47f8da78cd8b),volume_type_id=d17b6973-2060-4d33-ac14-47f8da78cd8b)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (697ed981-b6c8-4aff-a2a0-97d94f9bb888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (697ed981-b6c8-4aff-a2a0-97d94f9bb888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25866ce6-67b6-4a21-931c-cd54ac7ef4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25866ce6-67b6-4a21-931c-cd54ac7ef4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19ddb419-37b8-43d4-966a-b3f4239bb974', 'volume_name': 'volume-19ddb419-37b8-43d4-966a-b3f4239bb974', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2c4645-2414-4e9e-a649-fbc6b10cd0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2c4645-2414-4e9e-a649-fbc6b10cd0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b3a169-e486-4895-90b8-e579da2217d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:54 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Volume 19ddb419-37b8-43d4-966a-b3f4239bb974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19ddb419-37b8-43d4-966a-b3f4239bb974', 'volume_size': 1} Jul 06 15:32:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=89940787-d1a9-4a9a-a2e1-295b2599b6ca,created_at=2026-07-06T13:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2030454583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=89940787-d1a9-4a9a-a2e1-295b2599b6ca,host='devstack@QuobyteHD#QuobyteHD',id=19ddb419-37b8-43d4-966a-b3f4239bb974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4c8b5a32f704219a83d942fe04dd90e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:54Z,use_quota=True,user_id='42de5d683a2e412fae7837946f77aaeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d17b6973-2060-4d33-ac14-47f8da78cd8b),volume_type_id=d17b6973-2060-4d33-ac14-47f8da78cd8b)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:32:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Creating volume 19ddb419-37b8-43d4-966a-b3f4239bb974 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:32:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:32:54 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:32:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:54 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974 1073741824 Jul 06 15:32:54 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:55 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974 1073741824" returned: 0 in 1.092s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:55 devstack sudo[94841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974 Jul 06 15:32:55 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:56 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-076f612c-d414-4823-8dc9-58e98efd15e6 req-51d69f61-8dec-4bee-92d2-3148e14609ce tempest-AttachVolumeNegativeTest-823541462 None] Terminate volume connection completed successfully. Jul 06 15:32:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-076f612c-d414-4823-8dc9-58e98efd15e6 req-51d69f61-8dec-4bee-92d2-3148e14609ce tempest-AttachVolumeNegativeTest-823541462 None] Deleting attachment 8bc2496d-8732-40f6-aa36-19c9051b2b76. {{(pid=86148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:32:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974" returned: 0 in 1.041s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] <== create_volume: return (2245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:32:56 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.248s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b3a169-e486-4895-90b8-e579da2217d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19ddb419-37b8-43d4-966a-b3f4239bb974', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1d49b6b-33e5-4adb-899c-8acbb9505d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:56 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Volume volume-19ddb419-37b8-43d4-966a-b3f4239bb974 (19ddb419-37b8-43d4-966a-b3f4239bb974): created successfully Jul 06 15:32:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1d49b6b-33e5-4adb-899c-8acbb9505d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Flow 'volume_create_manager' (273b31ba-f193-4f3e-9413-3d842c467cbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:32:56 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-7680796d-32f3-4575-bbc6-2394f3fe399b tempest-GroupSnapshotsV319Test-1876811479 None] Created volume successfully. Jul 06 15:32:57 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-ef683fe8-5acb-4e02-9b09-b48bb5025361 tempest-GroupSnapshotsV319Test-1876811479 None] GroupSnapshot c1636d37-173f-446b-8a29-8b31df64f8d0: creating. Jul 06 15:32:57 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ef683fe8-5acb-4e02-9b09-b48bb5025361 tempest-GroupSnapshotsV319Test-1876811479 None] Group snapshot c1636d37-173f-446b-8a29-8b31df64f8d0: creating. {{(pid=86148) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 15:32:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ef683fe8-5acb-4e02-9b09-b48bb5025361 tempest-GroupSnapshotsV319Test-1876811479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ef683fe8-5acb-4e02-9b09-b48bb5025361 tempest-GroupSnapshotsV319Test-1876811479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:57 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-ef683fe8-5acb-4e02-9b09-b48bb5025361 tempest-GroupSnapshotsV319Test-1876811479 None] Creating offline snapshot 9aa36293-aaa6-423a-bb55-f64be1b9c97b of volume 19ddb419-37b8-43d4-966a-b3f4239bb974 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:32:57 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6d9834-6720-48d7-9c2d-a96e1ab49807]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:32:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ef683fe8-5acb-4e02-9b09-b48bb5025361 tempest-GroupSnapshotsV319Test-1876811479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:57 devstack sudo[94846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974 Jul 06 15:32:57 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:59 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ef683fe8-5acb-4e02-9b09-b48bb5025361 tempest-GroupSnapshotsV319Test-1876811479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974" returned: 0 in 1.320s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ef683fe8-5acb-4e02-9b09-b48bb5025361 tempest-GroupSnapshotsV319Test-1876811479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974.9aa36293-aaa6-423a-bb55-f64be1b9c97b 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:59 devstack sudo[94852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974.9aa36293-aaa6-423a-bb55-f64be1b9c97b 1G Jul 06 15:32:59 devstack sudo[94852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ef683fe8-5acb-4e02-9b09-b48bb5025361 tempest-GroupSnapshotsV319Test-1876811479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974.9aa36293-aaa6-423a-bb55-f64be1b9c97b 1G" returned: 0 in 1.139s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:00 devstack sudo[94852]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ef683fe8-5acb-4e02-9b09-b48bb5025361 tempest-GroupSnapshotsV319Test-1876811479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19ddb419-37b8-43d4-966a-b3f4239bb974 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974.9aa36293-aaa6-423a-bb55-f64be1b9c97b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:00 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19ddb419-37b8-43d4-966a-b3f4239bb974 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974.9aa36293-aaa6-423a-bb55-f64be1b9c97b Jul 06 15:33:00 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:01 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ef683fe8-5acb-4e02-9b09-b48bb5025361 tempest-GroupSnapshotsV319Test-1876811479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19ddb419-37b8-43d4-966a-b3f4239bb974 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974.9aa36293-aaa6-423a-bb55-f64be1b9c97b" returned: 0 in 1.391s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:01 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-ef683fe8-5acb-4e02-9b09-b48bb5025361 tempest-GroupSnapshotsV319Test-1876811479 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974.9aa36293-aaa6-423a-bb55-f64be1b9c97b is being set with open permissions: ugo+rw: NotImplementedError Jul 06 15:33:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ef683fe8-5acb-4e02-9b09-b48bb5025361 tempest-GroupSnapshotsV319Test-1876811479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974.9aa36293-aaa6-423a-bb55-f64be1b9c97b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:01 devstack sudo[94886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974.9aa36293-aaa6-423a-bb55-f64be1b9c97b Jul 06 15:33:01 devstack sudo[94886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:02 devstack sudo[94886]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ef683fe8-5acb-4e02-9b09-b48bb5025361 tempest-GroupSnapshotsV319Test-1876811479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974.9aa36293-aaa6-423a-bb55-f64be1b9c97b" returned: 0 in 1.075s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ef683fe8-5acb-4e02-9b09-b48bb5025361 tempest-GroupSnapshotsV319Test-1876811479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:02 devstack sudo[94892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974.info Jul 06 15:33:02 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:03 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:33:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Flow 'volume_create_manager' (444ef394-7ee7-4820-bf55-02c88212d98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:33:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aecb123-3173-49f1-8be2-f307a4280e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aecb123-3173-49f1-8be2-f307a4280e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1287370530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef3bbb62-8068-4651-80bf-5522e0582f47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76580de4b05a4d98a83ee280cdcc786a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:03Z,use_quota=True,user_id='2b7c5f262a2f4d00bc1002469365aa16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b1300be-1047-4f47-9af8-c0ec7678b33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b1300be-1047-4f47-9af8-c0ec7678b33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752f4ec0-3b5b-4bb7-acfb-4a91923f8007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752f4ec0-3b5b-4bb7-acfb-4a91923f8007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef3bbb62-8068-4651-80bf-5522e0582f47', 'volume_name': 'volume-ef3bbb62-8068-4651-80bf-5522e0582f47', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e98e179-aca4-4f8a-ac8f-bdf30ed50a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e98e179-aca4-4f8a-ac8f-bdf30ed50a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c54382fe-e3bf-4c7c-8db1-37c9c4c6ba47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:03 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Volume ef3bbb62-8068-4651-80bf-5522e0582f47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef3bbb62-8068-4651-80bf-5522e0582f47', 'volume_size': 1} Jul 06 15:33:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:03 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ef683fe8-5acb-4e02-9b09-b48bb5025361 tempest-GroupSnapshotsV319Test-1876811479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974.info" returned: 0 in 0.764s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:03 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-ef683fe8-5acb-4e02-9b09-b48bb5025361 tempest-GroupSnapshotsV319Test-1876811479 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 15:33:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ef683fe8-5acb-4e02-9b09-b48bb5025361 tempest-GroupSnapshotsV319Test-1876811479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:03 devstack sudo[94895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974.info Jul 06 15:33:03 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:04 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ef683fe8-5acb-4e02-9b09-b48bb5025361 tempest-GroupSnapshotsV319Test-1876811479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974.info" returned: 0 in 0.715s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ef683fe8-5acb-4e02-9b09-b48bb5025361 tempest-GroupSnapshotsV319Test-1876811479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.525s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.985s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:04 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1287370530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef3bbb62-8068-4651-80bf-5522e0582f47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76580de4b05a4d98a83ee280cdcc786a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:03Z,use_quota=True,user_id='2b7c5f262a2f4d00bc1002469365aa16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:33:04 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Creating volume ef3bbb62-8068-4651-80bf-5522e0582f47 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:33:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:04 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:04 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:04 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:33:04 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:33:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:04 devstack sudo[94926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47 1073741824 Jul 06 15:33:04 devstack sudo[94926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:04 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-ef683fe8-5acb-4e02-9b09-b48bb5025361 tempest-GroupSnapshotsV319Test-1876811479 None] group_snapshot c1636d37-173f-446b-8a29-8b31df64f8d0: created successfully Jul 06 15:33:05 devstack sudo[94926]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47 1073741824" returned: 0 in 0.863s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:05 devstack sudo[94932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47 Jul 06 15:33:05 devstack sudo[94932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:05 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-4223a3df-2fce-477e-a56e-148eda839e9f tempest-GroupSnapshotsV319Test-1876811479 None] group_snapshot c1636d37-173f-446b-8a29-8b31df64f8d0: deleting Jul 06 15:33:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4223a3df-2fce-477e-a56e-148eda839e9f tempest-GroupSnapshotsV319Test-1876811479 None] group_snapshot c1636d37-173f-446b-8a29-8b31df64f8d0: deleting {{(pid=86148) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 15:33:05 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4223a3df-2fce-477e-a56e-148eda839e9f tempest-GroupSnapshotsV319Test-1876811479 None] Acquiring lock "cinder-quobyte-19ddb419-37b8-43d4-966a-b3f4239bb974" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:05 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4223a3df-2fce-477e-a56e-148eda839e9f tempest-GroupSnapshotsV319Test-1876811479 None] Lock "cinder-quobyte-19ddb419-37b8-43d4-966a-b3f4239bb974" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:05 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4223a3df-2fce-477e-a56e-148eda839e9f tempest-GroupSnapshotsV319Test-1876811479 None] Acquiring lock "cinder-quobyte-9aa36293-aaa6-423a-bb55-f64be1b9c97b" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:05 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4223a3df-2fce-477e-a56e-148eda839e9f tempest-GroupSnapshotsV319Test-1876811479 None] Lock "cinder-quobyte-9aa36293-aaa6-423a-bb55-f64be1b9c97b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:05 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-4223a3df-2fce-477e-a56e-148eda839e9f tempest-GroupSnapshotsV319Test-1876811479 None] Deleting offline snapshot 9aa36293-aaa6-423a-bb55-f64be1b9c97b of volume 19ddb419-37b8-43d4-966a-b3f4239bb974 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:33:05 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-4223a3df-2fce-477e-a56e-148eda839e9f tempest-GroupSnapshotsV319Test-1876811479 None] snapshot_file for this snap is: volume-19ddb419-37b8-43d4-966a-b3f4239bb974.9aa36293-aaa6-423a-bb55-f64be1b9c97b {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:33:05 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9c9938-937f-402c-bb13-0c9830f9cfb7]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4223a3df-2fce-477e-a56e-148eda839e9f tempest-GroupSnapshotsV319Test-1876811479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974.9aa36293-aaa6-423a-bb55-f64be1b9c97b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:05 devstack sudo[94932]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47" returned: 0 in 0.716s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:05 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:33:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c54382fe-e3bf-4c7c-8db1-37c9c4c6ba47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef3bbb62-8068-4651-80bf-5522e0582f47', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e9bc38-355d-4f8e-ba6d-27f85663c8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:05 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Volume volume-ef3bbb62-8068-4651-80bf-5522e0582f47 (ef3bbb62-8068-4651-80bf-5522e0582f47): created successfully Jul 06 15:33:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e9bc38-355d-4f8e-ba6d-27f85663c8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:05 devstack sudo[94935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974.9aa36293-aaa6-423a-bb55-f64be1b9c97b Jul 06 15:33:05 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Flow 'volume_create_manager' (444ef394-7ee7-4820-bf55-02c88212d98f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:33:05 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-5f7125b7-a7a3-4828-b4cd-a897c2a22f4c tempest-VolumesCloneTest-2065886023 None] Created volume successfully. Jul 06 15:33:06 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:33:06 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4223a3df-2fce-477e-a56e-148eda839e9f tempest-GroupSnapshotsV319Test-1876811479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974.9aa36293-aaa6-423a-bb55-f64be1b9c97b" returned: 0 in 0.850s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:06 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-4223a3df-2fce-477e-a56e-148eda839e9f tempest-GroupSnapshotsV319Test-1876811479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19ddb419-37b8-43d4-966a-b3f4239bb974(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:33:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Flow 'volume_create_manager' (ce00abfc-48bf-4e71-8faa-35af4255405b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:33:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae3e3df5-cf5b-48b3-b8b5-2535fc9430e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:06 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1952718-bbe6-4ea3-9ae3-5adbb65064f0]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4223a3df-2fce-477e-a56e-148eda839e9f tempest-GroupSnapshotsV319Test-1876811479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae3e3df5-cf5b-48b3-b8b5-2535fc9430e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-125333006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9955d502-adf0-4ac5-80e9-2e69f6de22f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76580de4b05a4d98a83ee280cdcc786a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=ef3bbb62-8068-4651-80bf-5522e0582f47,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:06Z,use_quota=True,user_id='2b7c5f262a2f4d00bc1002469365aa16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02e990a-26c4-416a-9cd0-389f74a4a11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02e990a-26c4-416a-9cd0-389f74a4a11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (303f2fd0-b10f-46e6-825e-03fa37caa894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (303f2fd0-b10f-46e6-825e-03fa37caa894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9955d502-adf0-4ac5-80e9-2e69f6de22f6', 'volume_name': 'volume-9955d502-adf0-4ac5-80e9-2e69f6de22f6', 'volume_size': 2, 'source_volid': 'ef3bbb62-8068-4651-80bf-5522e0582f47', 'source_volstatus': 'available'}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2a50376-a5eb-4058-aab1-9cf598b29d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2a50376-a5eb-4058-aab1-9cf598b29d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a19f30d2-19bb-4cb1-b92e-a62d6b45edd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:06 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Volume 9955d502-adf0-4ac5-80e9-2e69f6de22f6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9955d502-adf0-4ac5-80e9-2e69f6de22f6', 'volume_size': 2, 'source_volid': 'ef3bbb62-8068-4651-80bf-5522e0582f47', 'source_volstatus': 'available'} Jul 06 15:33:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:06 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Cloning volume ef3bbb62-8068-4651-80bf-5522e0582f47 to volume 9955d502-adf0-4ac5-80e9-2e69f6de22f6 Jul 06 15:33:06 devstack sudo[94940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974 Jul 06 15:33:06 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:06 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Creating offline snapshot 1dc19d6b-3063-4d83-aa10-c5b62474adb4 of volume ef3bbb62-8068-4651-80bf-5522e0582f47 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:33:06 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd24972-4693-4559-ad63-d3fcc67486eb]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:06 devstack sudo[94942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47 Jul 06 15:33:06 devstack sudo[94942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:07 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4223a3df-2fce-477e-a56e-148eda839e9f tempest-GroupSnapshotsV319Test-1876811479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974" returned: 0 in 0.864s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4223a3df-2fce-477e-a56e-148eda839e9f tempest-GroupSnapshotsV319Test-1876811479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974.9aa36293-aaa6-423a-bb55-f64be1b9c97b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:07 devstack sudo[94949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974.9aa36293-aaa6-423a-bb55-f64be1b9c97b Jul 06 15:33:07 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:07 devstack sudo[94942]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47" returned: 0 in 0.854s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.1dc19d6b-3063-4d83-aa10-c5b62474adb4 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:07 devstack sudo[94953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.1dc19d6b-3063-4d83-aa10-c5b62474adb4 1G Jul 06 15:33:07 devstack sudo[94953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:08 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4223a3df-2fce-477e-a56e-148eda839e9f tempest-GroupSnapshotsV319Test-1876811479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974.9aa36293-aaa6-423a-bb55-f64be1b9c97b" returned: 0 in 0.836s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4223a3df-2fce-477e-a56e-148eda839e9f tempest-GroupSnapshotsV319Test-1876811479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974.9aa36293-aaa6-423a-bb55-f64be1b9c97b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:08 devstack sudo[94961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974.9aa36293-aaa6-423a-bb55-f64be1b9c97b Jul 06 15:33:08 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:08 devstack sudo[94953]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.1dc19d6b-3063-4d83-aa10-c5b62474adb4 1G" returned: 0 in 1.021s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef3bbb62-8068-4651-80bf-5522e0582f47 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.1dc19d6b-3063-4d83-aa10-c5b62474adb4 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:08 devstack sudo[94965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef3bbb62-8068-4651-80bf-5522e0582f47 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.1dc19d6b-3063-4d83-aa10-c5b62474adb4 Jul 06 15:33:08 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:09 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4223a3df-2fce-477e-a56e-148eda839e9f tempest-GroupSnapshotsV319Test-1876811479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974.9aa36293-aaa6-423a-bb55-f64be1b9c97b" returned: 0 in 0.704s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:09 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4223a3df-2fce-477e-a56e-148eda839e9f tempest-GroupSnapshotsV319Test-1876811479 None] Lock "cinder-quobyte-9aa36293-aaa6-423a-bb55-f64be1b9c97b" released by "_delete_snapshot" :: held 3.399s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:09 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4223a3df-2fce-477e-a56e-148eda839e9f tempest-GroupSnapshotsV319Test-1876811479 None] Lock "cinder-quobyte-19ddb419-37b8-43d4-966a-b3f4239bb974" released by "delete_snapshot" :: held 3.426s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:09 devstack cinder-volume[86148]: WARNING cinder.quota [None req-4223a3df-2fce-477e-a56e-148eda839e9f tempest-GroupSnapshotsV319Test-1876811479 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-526519584 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-526519584, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:33:09 devstack cinder-volume[86148]: WARNING cinder.quota [None req-4223a3df-2fce-477e-a56e-148eda839e9f tempest-GroupSnapshotsV319Test-1876811479 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-526519584 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-526519584, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:33:09 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-4223a3df-2fce-477e-a56e-148eda839e9f tempest-GroupSnapshotsV319Test-1876811479 None] Created reservations ['4f504221-7e73-4a39-bcbf-03a42171a1d8', '484d4e32-a8f7-4920-b476-bc1edb138d7e', '149a3344-f526-479b-9314-d45158c71738', '202399cb-5671-44ee-aa1f-eb2071ca16bf'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:33:09 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-4223a3df-2fce-477e-a56e-148eda839e9f tempest-GroupSnapshotsV319Test-1876811479 None] group_snapshot c1636d37-173f-446b-8a29-8b31df64f8d0: deleted successfully Jul 06 15:33:09 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef3bbb62-8068-4651-80bf-5522e0582f47 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.1dc19d6b-3063-4d83-aa10-c5b62474adb4" returned: 0 in 0.749s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:09 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.1dc19d6b-3063-4d83-aa10-c5b62474adb4 is being set with open permissions: ugo+rw Jul 06 15:33:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.1dc19d6b-3063-4d83-aa10-c5b62474adb4 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:09 devstack sudo[94971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.1dc19d6b-3063-4d83-aa10-c5b62474adb4 Jul 06 15:33:09 devstack sudo[94971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:10 devstack sudo[94971]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.1dc19d6b-3063-4d83-aa10-c5b62474adb4" returned: 0 in 0.626s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:10 devstack sudo[94974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.info Jul 06 15:33:10 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4c158a62-2d48-49ae-a018-bdd64cc2adc4 tempest-GroupSnapshotsV319Test-1876811479 None] Acquiring lock "cinder-quobyte-19ddb419-37b8-43d4-966a-b3f4239bb974" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4c158a62-2d48-49ae-a018-bdd64cc2adc4 tempest-GroupSnapshotsV319Test-1876811479 None] Lock "cinder-quobyte-19ddb419-37b8-43d4-966a-b3f4239bb974" acquired by "delete_volume" :: waited 0.025s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:10 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fd6afd-b6ce-4103-9113-0bbdcc7d1bb8]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4c158a62-2d48-49ae-a018-bdd64cc2adc4 tempest-GroupSnapshotsV319Test-1876811479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:10 devstack sudo[94976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974 Jul 06 15:33:10 devstack sudo[94976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:11 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.info" returned: 0 in 0.976s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:11 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.info is being set with open permissions: ugo+rw Jul 06 15:33:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:11 devstack sudo[94982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.info Jul 06 15:33:11 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:11 devstack sudo[94976]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4c158a62-2d48-49ae-a018-bdd64cc2adc4 tempest-GroupSnapshotsV319Test-1876811479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974" returned: 0 in 0.986s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4c158a62-2d48-49ae-a018-bdd64cc2adc4 tempest-GroupSnapshotsV319Test-1876811479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:11 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974 Jul 06 15:33:11 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:11 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.info" returned: 0 in 0.747s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:11 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Acquiring lock "cinder-quobyte-9955d502-adf0-4ac5-80e9-2e69f6de22f6" by "_copy_volume_from_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:11 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Lock "cinder-quobyte-9955d502-adf0-4ac5-80e9-2e69f6de22f6" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] snapshot: 1dc19d6b-3063-4d83-aa10-c5b62474adb4, volume: 9955d502-adf0-4ac5-80e9-2e69f6de22f6, {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 15:33:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:11 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc254dad-ca51-4e81-b513-ff4eeca60066]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.1dc19d6b-3063-4d83-aa10-c5b62474adb4 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:12 devstack sudo[94990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.1dc19d6b-3063-4d83-aa10-c5b62474adb4 Jul 06 15:33:12 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:12 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4c158a62-2d48-49ae-a018-bdd64cc2adc4 tempest-GroupSnapshotsV319Test-1876811479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-19ddb419-37b8-43d4-966a-b3f4239bb974" returned: 0 in 0.842s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:12 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4c158a62-2d48-49ae-a018-bdd64cc2adc4 tempest-GroupSnapshotsV319Test-1876811479 None] Lock "cinder-quobyte-19ddb419-37b8-43d4-966a-b3f4239bb974" released by "delete_volume" :: held 1.943s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:12 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-4c158a62-2d48-49ae-a018-bdd64cc2adc4 tempest-GroupSnapshotsV319Test-1876811479 None] Created reservations ['4b6224fd-991a-4a58-b5ee-aebe1369f04b'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:33:12 devstack cinder-volume[86148]: WARNING cinder.quota [None req-4c158a62-2d48-49ae-a018-bdd64cc2adc4 tempest-GroupSnapshotsV319Test-1876811479 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-526519584 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-526519584, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:33:12 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-4c158a62-2d48-49ae-a018-bdd64cc2adc4 tempest-GroupSnapshotsV319Test-1876811479 None] Created reservations ['1b71be20-17f0-4262-81a4-a10a8569e523', '6c56c162-19a6-48d8-b404-aaff5c4f038f', '91e8691f-1460-494c-99ed-3d26ac1522f4', '2794b4c7-011b-4e1a-b959-04326ca70d14'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:33:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4c158a62-2d48-49ae-a018-bdd64cc2adc4 tempest-GroupSnapshotsV319Test-1876811479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4c158a62-2d48-49ae-a018-bdd64cc2adc4 tempest-GroupSnapshotsV319Test-1876811479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4c158a62-2d48-49ae-a018-bdd64cc2adc4 tempest-GroupSnapshotsV319Test-1876811479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4c158a62-2d48-49ae-a018-bdd64cc2adc4 tempest-GroupSnapshotsV319Test-1876811479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4c158a62-2d48-49ae-a018-bdd64cc2adc4 tempest-GroupSnapshotsV319Test-1876811479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4c158a62-2d48-49ae-a018-bdd64cc2adc4 tempest-GroupSnapshotsV319Test-1876811479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:12 devstack sudo[94993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:33:12 devstack sudo[94993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:12 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.1dc19d6b-3063-4d83-aa10-c5b62474adb4" returned: 0 in 0.887s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef3bbb62-8068-4651-80bf-5522e0582f47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:33:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47 {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 15:33:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Creating direct copy from snapshot {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 15:33:12 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[741c72fd-97ff-4778-a841-e5aaab313ed5]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:12 devstack sudo[94999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47 Jul 06 15:33:12 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:13 devstack sudo[94993]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4c158a62-2d48-49ae-a018-bdd64cc2adc4 tempest-GroupSnapshotsV319Test-1876811479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.794s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:13 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-4c158a62-2d48-49ae-a018-bdd64cc2adc4 tempest-GroupSnapshotsV319Test-1876811479 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:33:13 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-4c158a62-2d48-49ae-a018-bdd64cc2adc4 tempest-GroupSnapshotsV319Test-1876811479 None] Delete group completed successfully. Jul 06 15:33:13 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47" returned: 0 in 0.829s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:13 devstack cinder-volume[86148]: DEBUG cinder.utils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Path /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9955d502-adf0-4ac5-80e9-2e69f6de22f6 not found in is_blk_device check {{(pid=86148) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 15:33:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9955d502-adf0-4ac5-80e9-2e69f6de22f6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:13 devstack sudo[95005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9955d502-adf0-4ac5-80e9-2e69f6de22f6 Jul 06 15:33:13 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:19 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9955d502-adf0-4ac5-80e9-2e69f6de22f6" returned: 0 in 6.136s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:19 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14056fe-8c5b-4fd4-b394-fdb9633c6bce]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:19 devstack sudo[95038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47 Jul 06 15:33:19 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:20 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47" returned: 0 in 1.086s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:20 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9955d502-adf0-4ac5-80e9-2e69f6de22f6 {{(pid=86148) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:33:20 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Converted 1024.00 MB image at 166.82 MB/s Jul 06 15:33:20 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9955d502-adf0-4ac5-80e9-2e69f6de22f6 is being set with open permissions: ugo+rw Jul 06 15:33:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9955d502-adf0-4ac5-80e9-2e69f6de22f6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:20 devstack sudo[95045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9955d502-adf0-4ac5-80e9-2e69f6de22f6 Jul 06 15:33:20 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:21 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9955d502-adf0-4ac5-80e9-2e69f6de22f6" returned: 0 in 0.698s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:21 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Lock "cinder-quobyte-9955d502-adf0-4ac5-80e9-2e69f6de22f6" released by "_copy_volume_from_snapshot" :: held 9.741s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:21 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Acquiring lock "cinder-quobyte-1dc19d6b-3063-4d83-aa10-c5b62474adb4" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:21 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Lock "cinder-quobyte-1dc19d6b-3063-4d83-aa10-c5b62474adb4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Deleting offline snapshot 1dc19d6b-3063-4d83-aa10-c5b62474adb4 of volume ef3bbb62-8068-4651-80bf-5522e0582f47 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:33:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] snapshot_file for this snap is: volume-ef3bbb62-8068-4651-80bf-5522e0582f47.1dc19d6b-3063-4d83-aa10-c5b62474adb4 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:33:21 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[5130a668-0c2e-40d7-9586-2c7851337468]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.1dc19d6b-3063-4d83-aa10-c5b62474adb4 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:21 devstack sudo[95049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.1dc19d6b-3063-4d83-aa10-c5b62474adb4 Jul 06 15:33:21 devstack sudo[95049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:22 devstack sudo[95049]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.1dc19d6b-3063-4d83-aa10-c5b62474adb4" returned: 0 in 0.809s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:22 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef3bbb62-8068-4651-80bf-5522e0582f47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:33:22 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[f537b73c-6d08-4ca7-b3d3-09f55e3633fd]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:22 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=83,cinder:INSERT=18,cinder:UPDATE=83,cinder:DELETE=3 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:33:22 devstack sudo[95055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47 Jul 06 15:33:22 devstack sudo[95055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-44328121-0776-4079-a5ef-60149b18a373 req-c4598b9d-cd14-475e-83b5-c249cd28b309 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:23 devstack sudo[95055]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47" returned: 0 in 0.831s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.1dc19d6b-3063-4d83-aa10-c5b62474adb4 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:23 devstack sudo[95068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.1dc19d6b-3063-4d83-aa10-c5b62474adb4 Jul 06 15:33:23 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:24 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.1dc19d6b-3063-4d83-aa10-c5b62474adb4" returned: 0 in 1.037s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.1dc19d6b-3063-4d83-aa10-c5b62474adb4 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:24 devstack sudo[95104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.1dc19d6b-3063-4d83-aa10-c5b62474adb4 Jul 06 15:33:24 devstack sudo[95104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:25 devstack sudo[95104]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47.1dc19d6b-3063-4d83-aa10-c5b62474adb4" returned: 0 in 0.835s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:25 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Lock "cinder-quobyte-1dc19d6b-3063-4d83-aa10-c5b62474adb4" released by "_delete_snapshot" :: held 3.636s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.592s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-44328121-0776-4079-a5ef-60149b18a373 req-c4598b9d-cd14-475e-83b5-c249cd28b309 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.378s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:25 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a19f30d2-19bb-4cb1-b92e-a62d6b45edd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9955d502-adf0-4ac5-80e9-2e69f6de22f6', 'volume_size': 2, 'source_volid': 'ef3bbb62-8068-4651-80bf-5522e0582f47', 'source_volstatus': 'available'}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:25 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4852daf8-586e-480b-96d5-15ab8b6074a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:25 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6f72b1-6995-4c6f-a142-98ba0283a7c6]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-44328121-0776-4079-a5ef-60149b18a373 req-c4598b9d-cd14-475e-83b5-c249cd28b309 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a2a3019a-7e8a-481e-a4e3-775d4df59a99 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:25 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Volume volume-9955d502-adf0-4ac5-80e9-2e69f6de22f6 (9955d502-adf0-4ac5-80e9-2e69f6de22f6): created successfully Jul 06 15:33:25 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4852daf8-586e-480b-96d5-15ab8b6074a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:25 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Flow 'volume_create_manager' (ce00abfc-48bf-4e71-8faa-35af4255405b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:33:25 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-2ae18240-5737-4ba7-ba27-24ccc49fb3ba tempest-VolumesCloneTest-2065886023 None] Created volume successfully. Jul 06 15:33:25 devstack sudo[95123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a2a3019a-7e8a-481e-a4e3-775d4df59a99 Jul 06 15:33:25 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:26 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-44328121-0776-4079-a5ef-60149b18a373 req-c4598b9d-cd14-475e-83b5-c249cd28b309 tempest-TestServerVolumeAttachmentScenario-2147023309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a2a3019a-7e8a-481e-a4e3-775d4df59a99" returned: 0 in 0.950s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-44328121-0776-4079-a5ef-60149b18a373 req-c4598b9d-cd14-475e-83b5-c249cd28b309 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.987s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:26 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-44328121-0776-4079-a5ef-60149b18a373 req-c4598b9d-cd14-475e-83b5-c249cd28b309 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce', 'name': 'volume-a2a3019a-7e8a-481e-a4e3-775d4df59a99', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '479cf5d1-540e-4bf0-9afc-43550d5b07cc', 'enforce_multipath': True} {{(pid=86148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:33:26 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-44328121-0776-4079-a5ef-60149b18a373 req-c4598b9d-cd14-475e-83b5-c249cd28b309 tempest-TestServerVolumeAttachmentScenario-2147023309 None] attachment_update completed successfully. Jul 06 15:33:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2a861ab7-2c80-49c2-bc0a-82e0f8666f1a tempest-VolumesCloneTest-2065886023 None] Acquiring lock "cinder-9955d502-adf0-4ac5-80e9-2e69f6de22f6-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2a861ab7-2c80-49c2-bc0a-82e0f8666f1a tempest-VolumesCloneTest-2065886023 None] Lock "cinder-9955d502-adf0-4ac5-80e9-2e69f6de22f6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2a861ab7-2c80-49c2-bc0a-82e0f8666f1a tempest-VolumesCloneTest-2065886023 None] Acquiring lock "cinder-quobyte-9955d502-adf0-4ac5-80e9-2e69f6de22f6" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2a861ab7-2c80-49c2-bc0a-82e0f8666f1a tempest-VolumesCloneTest-2065886023 None] Lock "cinder-quobyte-9955d502-adf0-4ac5-80e9-2e69f6de22f6" acquired by "delete_volume" :: waited 0.029s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:26 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[704887ee-2b40-400f-8047-766e66710938]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2a861ab7-2c80-49c2-bc0a-82e0f8666f1a tempest-VolumesCloneTest-2065886023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9955d502-adf0-4ac5-80e9-2e69f6de22f6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:26 devstack sudo[95147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9955d502-adf0-4ac5-80e9-2e69f6de22f6 Jul 06 15:33:26 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:27 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2a861ab7-2c80-49c2-bc0a-82e0f8666f1a tempest-VolumesCloneTest-2065886023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9955d502-adf0-4ac5-80e9-2e69f6de22f6" returned: 0 in 0.943s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2a861ab7-2c80-49c2-bc0a-82e0f8666f1a tempest-VolumesCloneTest-2065886023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9955d502-adf0-4ac5-80e9-2e69f6de22f6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:27 devstack sudo[95220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9955d502-adf0-4ac5-80e9-2e69f6de22f6 Jul 06 15:33:27 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:28 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2a861ab7-2c80-49c2-bc0a-82e0f8666f1a tempest-VolumesCloneTest-2065886023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9955d502-adf0-4ac5-80e9-2e69f6de22f6" returned: 0 in 0.965s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:28 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2a861ab7-2c80-49c2-bc0a-82e0f8666f1a tempest-VolumesCloneTest-2065886023 None] Lock "cinder-quobyte-9955d502-adf0-4ac5-80e9-2e69f6de22f6" released by "delete_volume" :: held 1.977s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:28 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:INSERT=24,cinder:UPDATE=96,cinder:SELECT=60,cinder:DELETE=10 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:33:28 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-2a861ab7-2c80-49c2-bc0a-82e0f8666f1a tempest-VolumesCloneTest-2065886023 None] Created reservations ['4d5b811a-a000-4532-8562-542ad20f586c', '891a5bce-cb9f-4db7-8fe5-d805f45eae2b', '82c8cc0b-40c9-4d76-b530-82e3ef0e964e', 'dfa49e32-fc73-4a15-878c-8c7d1bad2948'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:33:28 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a911cdb5-03b0-420e-bb69-97cf52ebf6dd tempest-GroupsV314Test-1762870362 None] Group tempest-GroupsV314Test-Group-1569408729: creating Jul 06 15:33:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2a861ab7-2c80-49c2-bc0a-82e0f8666f1a tempest-VolumesCloneTest-2065886023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2a861ab7-2c80-49c2-bc0a-82e0f8666f1a tempest-VolumesCloneTest-2065886023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:28 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2a861ab7-2c80-49c2-bc0a-82e0f8666f1a tempest-VolumesCloneTest-2065886023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:28 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2a861ab7-2c80-49c2-bc0a-82e0f8666f1a tempest-VolumesCloneTest-2065886023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2a861ab7-2c80-49c2-bc0a-82e0f8666f1a tempest-VolumesCloneTest-2065886023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2a861ab7-2c80-49c2-bc0a-82e0f8666f1a tempest-VolumesCloneTest-2065886023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:28 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:33:28 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:28 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a911cdb5-03b0-420e-bb69-97cf52ebf6dd tempest-GroupsV314Test-1762870362 None] Group tempest-GroupsV314Test-Group-1569408729: created successfully Jul 06 15:33:29 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a911cdb5-03b0-420e-bb69-97cf52ebf6dd tempest-GroupsV314Test-1762870362 None] Create group completed successfully. Jul 06 15:33:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a84620bf-f202-4374-a274-1f57faf9a74e tempest-VolumesCloneTest-2065886023 None] Acquiring lock "cinder-ef3bbb62-8068-4651-80bf-5522e0582f47-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a84620bf-f202-4374-a274-1f57faf9a74e tempest-VolumesCloneTest-2065886023 None] Lock "cinder-ef3bbb62-8068-4651-80bf-5522e0582f47-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a84620bf-f202-4374-a274-1f57faf9a74e tempest-VolumesCloneTest-2065886023 None] Acquiring lock "cinder-quobyte-ef3bbb62-8068-4651-80bf-5522e0582f47" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a84620bf-f202-4374-a274-1f57faf9a74e tempest-VolumesCloneTest-2065886023 None] Lock "cinder-quobyte-ef3bbb62-8068-4651-80bf-5522e0582f47" acquired by "delete_volume" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:29 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf52458-5bdb-436d-9bfd-8316472699ee]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a84620bf-f202-4374-a274-1f57faf9a74e tempest-VolumesCloneTest-2065886023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:29 devstack sudo[95541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47 Jul 06 15:33:29 devstack sudo[95541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:29 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2a861ab7-2c80-49c2-bc0a-82e0f8666f1a tempest-VolumesCloneTest-2065886023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.800s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:29 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-2a861ab7-2c80-49c2-bc0a-82e0f8666f1a tempest-VolumesCloneTest-2065886023 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:33:29 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-2a861ab7-2c80-49c2-bc0a-82e0f8666f1a tempest-VolumesCloneTest-2065886023 None] Deleted volume successfully. Jul 06 15:33:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2a861ab7-2c80-49c2-bc0a-82e0f8666f1a tempest-VolumesCloneTest-2065886023 None] Lock "cinder-9955d502-adf0-4ac5-80e9-2e69f6de22f6-delete_volume" released by "delete_volume" :: held 3.163s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:30 devstack sudo[95541]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a84620bf-f202-4374-a274-1f57faf9a74e tempest-VolumesCloneTest-2065886023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47" returned: 0 in 0.935s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a84620bf-f202-4374-a274-1f57faf9a74e tempest-VolumesCloneTest-2065886023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:30 devstack sudo[95547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47 Jul 06 15:33:30 devstack sudo[95547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:30 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:33:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Flow 'volume_create_manager' (2b9b61d5-1080-4d72-a615-cf515d4a1c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:33:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25108207-b0be-4fe3-8819-cbd855802bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25108207-b0be-4fe3-8819-cbd855802bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1221485591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dcc1b258-4c13-42fd-a1d1-061450b576bb,host='devstack@QuobyteHD#QuobyteHD',id=eedc990b-dd57-4fab-adac-029d46a98532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816b1c6b372947ad9e2249b9592982a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:31Z,use_quota=True,user_id='80242eea241d4b43a5b90334ceee1006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4453ef5b-c54a-4236-bed9-20c8274b4766),volume_type_id=4453ef5b-c54a-4236-bed9-20c8274b4766)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c69ba5-9227-4d48-a605-47ad189187bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c69ba5-9227-4d48-a605-47ad189187bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c8db93-e5eb-4058-9193-30b87d3d1b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:31 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c8db93-e5eb-4058-9193-30b87d3d1b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eedc990b-dd57-4fab-adac-029d46a98532', 'volume_name': 'volume-eedc990b-dd57-4fab-adac-029d46a98532', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:31 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd6d267-5cea-456c-a9a0-414ecba095c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:31 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd6d267-5cea-456c-a9a0-414ecba095c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:31 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f412996-0cc3-4057-a65d-daddf21399ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:31 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Volume eedc990b-dd57-4fab-adac-029d46a98532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eedc990b-dd57-4fab-adac-029d46a98532', 'volume_size': 1} Jul 06 15:33:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:31 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dcc1b258-4c13-42fd-a1d1-061450b576bb,created_at=2026-07-06T13:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1221485591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dcc1b258-4c13-42fd-a1d1-061450b576bb,host='devstack@QuobyteHD#QuobyteHD',id=eedc990b-dd57-4fab-adac-029d46a98532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816b1c6b372947ad9e2249b9592982a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:31Z,use_quota=True,user_id='80242eea241d4b43a5b90334ceee1006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4453ef5b-c54a-4236-bed9-20c8274b4766),volume_type_id=4453ef5b-c54a-4236-bed9-20c8274b4766)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:33:31 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Creating volume eedc990b-dd57-4fab-adac-029d46a98532 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:33:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:31 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:31 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:31 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:33:31 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:33:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:31 devstack sudo[95551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532 1073741824 Jul 06 15:33:31 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:31 devstack sudo[95547]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a84620bf-f202-4374-a274-1f57faf9a74e tempest-VolumesCloneTest-2065886023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ef3bbb62-8068-4651-80bf-5522e0582f47" returned: 0 in 1.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:31 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a84620bf-f202-4374-a274-1f57faf9a74e tempest-VolumesCloneTest-2065886023 None] Lock "cinder-quobyte-ef3bbb62-8068-4651-80bf-5522e0582f47" released by "delete_volume" :: held 2.053s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:31 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-a84620bf-f202-4374-a274-1f57faf9a74e tempest-VolumesCloneTest-2065886023 None] Created reservations ['2b5faecc-005f-4f8a-a037-4c3df72237ef', '20b07fe3-34b6-4675-8fa8-ab01995b5af3', '4b935025-8b46-4921-9331-20dab98c223c', '09ae768f-5346-483f-a61e-f2de78428841'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:33:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a84620bf-f202-4374-a274-1f57faf9a74e tempest-VolumesCloneTest-2065886023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a84620bf-f202-4374-a274-1f57faf9a74e tempest-VolumesCloneTest-2065886023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:31 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a84620bf-f202-4374-a274-1f57faf9a74e tempest-VolumesCloneTest-2065886023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:31 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a84620bf-f202-4374-a274-1f57faf9a74e tempest-VolumesCloneTest-2065886023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a84620bf-f202-4374-a274-1f57faf9a74e tempest-VolumesCloneTest-2065886023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a84620bf-f202-4374-a274-1f57faf9a74e tempest-VolumesCloneTest-2065886023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:31 devstack sudo[95553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:33:31 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:32 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a84620bf-f202-4374-a274-1f57faf9a74e tempest-VolumesCloneTest-2065886023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.762s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:32 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-a84620bf-f202-4374-a274-1f57faf9a74e tempest-VolumesCloneTest-2065886023 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:33:32 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a84620bf-f202-4374-a274-1f57faf9a74e tempest-VolumesCloneTest-2065886023 None] Deleted volume successfully. Jul 06 15:33:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a84620bf-f202-4374-a274-1f57faf9a74e tempest-VolumesCloneTest-2065886023 None] Lock "cinder-ef3bbb62-8068-4651-80bf-5522e0582f47-delete_volume" released by "delete_volume" :: held 3.137s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:32 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532 1073741824" returned: 0 in 1.164s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:32 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532 Jul 06 15:33:32 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:33 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532" returned: 0 in 1.205s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] <== create_volume: return (2442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:33:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.447s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f412996-0cc3-4057-a65d-daddf21399ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eedc990b-dd57-4fab-adac-029d46a98532', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7e6d603-6a12-4ce0-8d59-a33756c5adbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:33 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Volume volume-eedc990b-dd57-4fab-adac-029d46a98532 (eedc990b-dd57-4fab-adac-029d46a98532): created successfully Jul 06 15:33:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7e6d603-6a12-4ce0-8d59-a33756c5adbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Flow 'volume_create_manager' (2b9b61d5-1080-4d72-a615-cf515d4a1c8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:33:33 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-53966461-2680-47cd-927e-a4887d7d3442 tempest-GroupsV314Test-1762870362 None] Created volume successfully. Jul 06 15:33:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:35 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Cloning volume eedc990b-dd57-4fab-adac-029d46a98532 to volume dcb024ac-55d9-4876-ac14-bb5862ccd087 Jul 06 15:33:35 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Creating offline snapshot 08d2c0b4-7ff9-45e8-904c-681bb8b9e035 of volume eedc990b-dd57-4fab-adac-029d46a98532 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:33:35 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[744f4dbb-742a-4d1c-a9d8-6bda71c8f339]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:35 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532 Jul 06 15:33:35 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:36 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:33:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Flow 'volume_create_manager' (0edb81f5-7eb4-4709-a96f-f2be7e2dfa2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:33:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d001f05-382a-46d3-9752-c647983aba1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d001f05-382a-46d3-9752-c647983aba1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1019233193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abb6edc2-d8aa-4a1e-9c51-28861f146225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dfaa5e801614e418799ef77db0b2a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:37Z,use_quota=True,user_id='06c2af438d0446baa513c5b67f86f96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3992092d-de0f-45bd-864e-2d13a8fd404e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3992092d-de0f-45bd-864e-2d13a8fd404e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1bf9e9b-7beb-4dd2-a46f-ba72d330992a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1bf9e9b-7beb-4dd2-a46f-ba72d330992a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abb6edc2-d8aa-4a1e-9c51-28861f146225', 'volume_name': 'volume-abb6edc2-d8aa-4a1e-9c51-28861f146225', 'volume_size': 2}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee70e4e6-abac-4366-aadb-1b8d85f8fff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee70e4e6-abac-4366-aadb-1b8d85f8fff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9dba949-c983-4e70-b315-0b02c3385a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:36 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Volume abb6edc2-d8aa-4a1e-9c51-28861f146225: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abb6edc2-d8aa-4a1e-9c51-28861f146225', 'volume_size': 2} Jul 06 15:33:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:36 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532" returned: 0 in 1.071s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.08d2c0b4-7ff9-45e8-904c-681bb8b9e035 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:36 devstack sudo[95612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.08d2c0b4-7ff9-45e8-904c-681bb8b9e035 1G Jul 06 15:33:36 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:37 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.08d2c0b4-7ff9-45e8-904c-681bb8b9e035 1G" returned: 0 in 0.863s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eedc990b-dd57-4fab-adac-029d46a98532 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.08d2c0b4-7ff9-45e8-904c-681bb8b9e035 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:37 devstack sudo[95618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eedc990b-dd57-4fab-adac-029d46a98532 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.08d2c0b4-7ff9-45e8-904c-681bb8b9e035 Jul 06 15:33:37 devstack sudo[95618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:33:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:38 devstack sudo[95618]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eedc990b-dd57-4fab-adac-029d46a98532 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.08d2c0b4-7ff9-45e8-904c-681bb8b9e035" returned: 0 in 0.668s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:38 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.08d2c0b4-7ff9-45e8-904c-681bb8b9e035 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 15:33:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.08d2c0b4-7ff9-45e8-904c-681bb8b9e035 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:38 devstack sudo[95623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:33:38 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:38 devstack sudo[95624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.08d2c0b4-7ff9-45e8-904c-681bb8b9e035 Jul 06 15:33:38 devstack sudo[95624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:39 devstack sudo[95624]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:39 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.08d2c0b4-7ff9-45e8-904c-681bb8b9e035" returned: 0 in 0.707s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.731s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:33:39 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager._thread_info {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:33:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread count: 28 {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:33:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread info: [<_MainThread(MainThread, started 124857273856128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:33:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:39 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.info Jul 06 15:33:39 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:39 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.info" returned: 0 in 0.690s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:39 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 15:33:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:39 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.info Jul 06 15:33:39 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-27c15ee6-7876-4d15-a686-9587ccf9a4b2 req-b13c9da2-46d8-4c73-bbba-3a3adf6ae521 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:40 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.info" returned: 0 in 0.648s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:40 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Acquiring lock "cinder-quobyte-dcb024ac-55d9-4876-ac14-bb5862ccd087" by "_copy_volume_from_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:40 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Lock "cinder-quobyte-dcb024ac-55d9-4876-ac14-bb5862ccd087" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] snapshot: 08d2c0b4-7ff9-45e8-904c-681bb8b9e035, volume: dcb024ac-55d9-4876-ac14-bb5862ccd087, {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 15:33:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:40 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[187e5ab7-e308-4f3e-a50f-5917a1606fce]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.08d2c0b4-7ff9-45e8-904c-681bb8b9e035 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:40 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.08d2c0b4-7ff9-45e8-904c-681bb8b9e035 Jul 06 15:33:40 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:41 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.08d2c0b4-7ff9-45e8-904c-681bb8b9e035" returned: 0 in 0.733s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:41 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eedc990b-dd57-4fab-adac-029d46a98532(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:33:41 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532 {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 15:33:41 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Creating direct copy from snapshot {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 15:33:41 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e1d372-f849-4eb8-aa86-743358c7427c]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:41 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532 Jul 06 15:33:41 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:42 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532" returned: 0 in 0.740s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:42 devstack cinder-volume[86148]: DEBUG cinder.utils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Path /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-dcb024ac-55d9-4876-ac14-bb5862ccd087 not found in is_blk_device check {{(pid=86148) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 15:33:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-dcb024ac-55d9-4876-ac14-bb5862ccd087 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:42 devstack sudo[95667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-dcb024ac-55d9-4876-ac14-bb5862ccd087 Jul 06 15:33:42 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:46 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-dcb024ac-55d9-4876-ac14-bb5862ccd087" returned: 0 in 4.530s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:46 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[95751830-528e-46e8-8d37-3c44b8552f4c]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:46 devstack sudo[95679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532 Jul 06 15:33:46 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:47 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532" returned: 0 in 0.916s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:47 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532, size 1024.00 MB, duration 4.53 sec, destination /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-dcb024ac-55d9-4876-ac14-bb5862ccd087 {{(pid=86148) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:33:47 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Converted 1024.00 MB image at 226.00 MB/s Jul 06 15:33:47 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-dcb024ac-55d9-4876-ac14-bb5862ccd087 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 15:33:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-dcb024ac-55d9-4876-ac14-bb5862ccd087 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:47 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-dcb024ac-55d9-4876-ac14-bb5862ccd087 Jul 06 15:33:47 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:48 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-dcb024ac-55d9-4876-ac14-bb5862ccd087" returned: 0 in 0.608s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Lock "cinder-quobyte-dcb024ac-55d9-4876-ac14-bb5862ccd087" released by "_copy_volume_from_snapshot" :: held 7.601s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Acquiring lock "cinder-quobyte-08d2c0b4-7ff9-45e8-904c-681bb8b9e035" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Lock "cinder-quobyte-08d2c0b4-7ff9-45e8-904c-681bb8b9e035" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:48 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Deleting offline snapshot 08d2c0b4-7ff9-45e8-904c-681bb8b9e035 of volume eedc990b-dd57-4fab-adac-029d46a98532 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:33:48 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] snapshot_file for this snap is: volume-eedc990b-dd57-4fab-adac-029d46a98532.08d2c0b4-7ff9-45e8-904c-681bb8b9e035 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:33:48 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[551ac2d0-c312-412f-b811-86624c13a473]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.08d2c0b4-7ff9-45e8-904c-681bb8b9e035 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:48 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.08d2c0b4-7ff9-45e8-904c-681bb8b9e035 Jul 06 15:33:48 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:48 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.08d2c0b4-7ff9-45e8-904c-681bb8b9e035" returned: 0 in 0.712s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:48 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eedc990b-dd57-4fab-adac-029d46a98532(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:33:48 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[1087bb69-cc1e-445d-9e72-b657d1cc38c5]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:49 devstack sudo[95717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532 Jul 06 15:33:49 devstack sudo[95717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:49 devstack sudo[95717]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532" returned: 0 in 0.779s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.08d2c0b4-7ff9-45e8-904c-681bb8b9e035 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:49 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.08d2c0b4-7ff9-45e8-904c-681bb8b9e035 Jul 06 15:33:49 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:49 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=30,cinder:UPDATE=27,cinder:INSERT=9,cinder:DELETE=1 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:33:50 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.08d2c0b4-7ff9-45e8-904c-681bb8b9e035" returned: 0 in 0.690s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.08d2c0b4-7ff9-45e8-904c-681bb8b9e035 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:50 devstack sudo[95727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.08d2c0b4-7ff9-45e8-904c-681bb8b9e035 Jul 06 15:33:50 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:51 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532.08d2c0b4-7ff9-45e8-904c-681bb8b9e035" returned: 0 in 0.601s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:51 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Lock "cinder-quobyte-08d2c0b4-7ff9-45e8-904c-681bb8b9e035" released by "_delete_snapshot" :: held 2.877s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.346s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.325s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1019233193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abb6edc2-d8aa-4a1e-9c51-28861f146225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dfaa5e801614e418799ef77db0b2a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:37Z,use_quota=True,user_id='06c2af438d0446baa513c5b67f86f96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:33:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Creating volume abb6edc2-d8aa-4a1e-9c51-28861f146225 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:33:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:33:51 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:33:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-abb6edc2-d8aa-4a1e-9c51-28861f146225 2147483648 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:51 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-abb6edc2-d8aa-4a1e-9c51-28861f146225 2147483648 Jul 06 15:33:51 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:51 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-8855dc48-c714-4e9e-8587-fb77d5b3d335 tempest-GroupsV314Test-1762870362 None] Create group from source-group-dcc1b258-4c13-42fd-a1d1-061450b576bb completed successfully. Jul 06 15:33:51 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:33:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Flow 'volume_create_manager' (567e867d-6e37-47c3-834a-74bc72caf418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:33:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8d4767-9d18-4768-bd85-d9e98d708511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8d4767-9d18-4768-bd85-d9e98d708511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-934955465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ebf58fc-b295-4a17-803b-ada403c83c56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c45904797864f8493a520651b327e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:52Z,use_quota=True,user_id='309365767b814ec0840ec934b3ec107c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb80cdbe-815b-4ebe-9b86-8a400f8f8aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb80cdbe-815b-4ebe-9b86-8a400f8f8aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799efb41-e7c7-4744-a5e7-5b3de20cb50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799efb41-e7c7-4744-a5e7-5b3de20cb50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ebf58fc-b295-4a17-803b-ada403c83c56', 'volume_name': 'volume-6ebf58fc-b295-4a17-803b-ada403c83c56', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f22581-9579-42f4-a78e-0e28e0e3ae1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f22581-9579-42f4-a78e-0e28e0e3ae1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59317f60-916f-458e-84fe-bec503e1e6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:51 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Volume 6ebf58fc-b295-4a17-803b-ada403c83c56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ebf58fc-b295-4a17-803b-ada403c83c56', 'volume_size': 1} Jul 06 15:33:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:51 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-abb6edc2-d8aa-4a1e-9c51-28861f146225 2147483648" returned: 0 in 0.894s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-abb6edc2-d8aa-4a1e-9c51-28861f146225 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:52 devstack sudo[95739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-abb6edc2-d8aa-4a1e-9c51-28861f146225 Jul 06 15:33:52 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:52 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ee9fca22-1852-4b24-932d-41ae55470a1b tempest-GroupsV314Test-1762870362 None] Acquiring lock "cinder-quobyte-dcb024ac-55d9-4876-ac14-bb5862ccd087" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:52 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ee9fca22-1852-4b24-932d-41ae55470a1b tempest-GroupsV314Test-1762870362 None] Lock "cinder-quobyte-dcb024ac-55d9-4876-ac14-bb5862ccd087" acquired by "delete_volume" :: waited 0.021s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:52 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b33cb47-c5a6-4deb-84fb-8b2f00159808]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ee9fca22-1852-4b24-932d-41ae55470a1b tempest-GroupsV314Test-1762870362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-dcb024ac-55d9-4876-ac14-bb5862ccd087 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:52 devstack sudo[95754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-dcb024ac-55d9-4876-ac14-bb5862ccd087 Jul 06 15:33:52 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:52 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-abb6edc2-d8aa-4a1e-9c51-28861f146225" returned: 0 in 0.668s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:52 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:33:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-27c15ee6-7876-4d15-a686-9587ccf9a4b2 req-b13c9da2-46d8-4c73-bbba-3a3adf6ae521 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.782s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9dba949-c983-4e70-b315-0b02c3385a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abb6edc2-d8aa-4a1e-9c51-28861f146225', 'volume_size': 2}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f33fcb-4d45-4b28-87c9-c4cfdc84fc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:52 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b06bf2-8d31-494b-9844-862318d40ead]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-27c15ee6-7876-4d15-a686-9587ccf9a4b2 req-b13c9da2-46d8-4c73-bbba-3a3adf6ae521 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-14336ae6-5e39-4123-9de6-9cfafd231a05 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:52 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Volume volume-abb6edc2-d8aa-4a1e-9c51-28861f146225 (abb6edc2-d8aa-4a1e-9c51-28861f146225): created successfully Jul 06 15:33:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f33fcb-4d45-4b28-87c9-c4cfdc84fc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Flow 'volume_create_manager' (0edb81f5-7eb4-4709-a96f-f2be7e2dfa2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:33:52 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-409df053-b120-4312-b029-1801905c3067 tempest-VolumesCloneNegativeTest-1791192699 None] Created volume successfully. Jul 06 15:33:52 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-14336ae6-5e39-4123-9de6-9cfafd231a05 Jul 06 15:33:52 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:53 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ee9fca22-1852-4b24-932d-41ae55470a1b tempest-GroupsV314Test-1762870362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-dcb024ac-55d9-4876-ac14-bb5862ccd087" returned: 0 in 0.804s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ee9fca22-1852-4b24-932d-41ae55470a1b tempest-GroupsV314Test-1762870362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-dcb024ac-55d9-4876-ac14-bb5862ccd087 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:53 devstack sudo[95768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-dcb024ac-55d9-4876-ac14-bb5862ccd087 Jul 06 15:33:53 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:53 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9ae7cb0c-cfcb-4645-8840-ab9b12bfdf8b tempest-VolumesCloneNegativeTest-1791192699 None] Acquiring lock "cinder-abb6edc2-d8aa-4a1e-9c51-28861f146225-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:53 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9ae7cb0c-cfcb-4645-8840-ab9b12bfdf8b tempest-VolumesCloneNegativeTest-1791192699 None] Lock "cinder-abb6edc2-d8aa-4a1e-9c51-28861f146225-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:53 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9ae7cb0c-cfcb-4645-8840-ab9b12bfdf8b tempest-VolumesCloneNegativeTest-1791192699 None] Acquiring lock "cinder-quobyte-abb6edc2-d8aa-4a1e-9c51-28861f146225" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:53 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9ae7cb0c-cfcb-4645-8840-ab9b12bfdf8b tempest-VolumesCloneNegativeTest-1791192699 None] Lock "cinder-quobyte-abb6edc2-d8aa-4a1e-9c51-28861f146225" acquired by "delete_volume" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:53 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[221941f3-f045-47f6-8d26-d0a7ac391754]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9ae7cb0c-cfcb-4645-8840-ab9b12bfdf8b tempest-VolumesCloneNegativeTest-1791192699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-abb6edc2-d8aa-4a1e-9c51-28861f146225 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:53 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-abb6edc2-d8aa-4a1e-9c51-28861f146225 Jul 06 15:33:53 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:53 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-27c15ee6-7876-4d15-a686-9587ccf9a4b2 req-b13c9da2-46d8-4c73-bbba-3a3adf6ae521 tempest-TestServerVolumeAttachmentScenario-2147023309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-14336ae6-5e39-4123-9de6-9cfafd231a05" returned: 0 in 0.823s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-27c15ee6-7876-4d15-a686-9587ccf9a4b2 req-b13c9da2-46d8-4c73-bbba-3a3adf6ae521 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.861s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.661s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:53 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-934955465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ebf58fc-b295-4a17-803b-ada403c83c56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c45904797864f8493a520651b327e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:52Z,use_quota=True,user_id='309365767b814ec0840ec934b3ec107c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:33:53 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Creating volume 6ebf58fc-b295-4a17-803b-ada403c83c56 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:33:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:53 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:53 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:53 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:33:53 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:33:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6ebf58fc-b295-4a17-803b-ada403c83c56 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:53 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6ebf58fc-b295-4a17-803b-ada403c83c56 1073741824 Jul 06 15:33:53 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-27c15ee6-7876-4d15-a686-9587ccf9a4b2 req-b13c9da2-46d8-4c73-bbba-3a3adf6ae521 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce', 'name': 'volume-14336ae6-5e39-4123-9de6-9cfafd231a05', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be1abb8b-7090-4907-a2be-251917889968', 'enforce_multipath': True} {{(pid=86148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:33:53 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-27c15ee6-7876-4d15-a686-9587ccf9a4b2 req-b13c9da2-46d8-4c73-bbba-3a3adf6ae521 tempest-TestServerVolumeAttachmentScenario-2147023309 None] attachment_update completed successfully. Jul 06 15:33:54 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ee9fca22-1852-4b24-932d-41ae55470a1b tempest-GroupsV314Test-1762870362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-dcb024ac-55d9-4876-ac14-bb5862ccd087" returned: 0 in 0.774s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ee9fca22-1852-4b24-932d-41ae55470a1b tempest-GroupsV314Test-1762870362 None] Lock "cinder-quobyte-dcb024ac-55d9-4876-ac14-bb5862ccd087" released by "delete_volume" :: held 1.627s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:54 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-ee9fca22-1852-4b24-932d-41ae55470a1b tempest-GroupsV314Test-1762870362 None] Created reservations ['dd2dc4b7-bd1d-483e-8da4-c0ed79b24775'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:33:54 devstack cinder-volume[86148]: WARNING cinder.quota [None req-ee9fca22-1852-4b24-932d-41ae55470a1b tempest-GroupsV314Test-1762870362 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-564412928 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-564412928, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:33:54 devstack cinder-volume[86148]: WARNING cinder.quota [None req-ee9fca22-1852-4b24-932d-41ae55470a1b tempest-GroupsV314Test-1762870362 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-564412928 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-564412928, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:33:54 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-ee9fca22-1852-4b24-932d-41ae55470a1b tempest-GroupsV314Test-1762870362 None] Created reservations ['0cd33a06-8890-4b9c-81c5-081755170ac7', 'a6b551ed-2fc9-478f-afa0-bed0bd877bbc', '11fb194e-e6b1-4605-8d85-c05bb5c239ce', '4ece4739-45b0-4afe-bd2b-8eb4bdf8f943'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:33:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ee9fca22-1852-4b24-932d-41ae55470a1b tempest-GroupsV314Test-1762870362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ee9fca22-1852-4b24-932d-41ae55470a1b tempest-GroupsV314Test-1762870362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ee9fca22-1852-4b24-932d-41ae55470a1b tempest-GroupsV314Test-1762870362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ee9fca22-1852-4b24-932d-41ae55470a1b tempest-GroupsV314Test-1762870362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ee9fca22-1852-4b24-932d-41ae55470a1b tempest-GroupsV314Test-1762870362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ee9fca22-1852-4b24-932d-41ae55470a1b tempest-GroupsV314Test-1762870362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:54 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:33:54 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:54 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9ae7cb0c-cfcb-4645-8840-ab9b12bfdf8b tempest-VolumesCloneNegativeTest-1791192699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-abb6edc2-d8aa-4a1e-9c51-28861f146225" returned: 0 in 0.928s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9ae7cb0c-cfcb-4645-8840-ab9b12bfdf8b tempest-VolumesCloneNegativeTest-1791192699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-abb6edc2-d8aa-4a1e-9c51-28861f146225 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:54 devstack sudo[95786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-abb6edc2-d8aa-4a1e-9c51-28861f146225 Jul 06 15:33:54 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:54 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6ebf58fc-b295-4a17-803b-ada403c83c56 1073741824" returned: 0 in 1.013s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6ebf58fc-b295-4a17-803b-ada403c83c56 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:54 devstack sudo[95792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6ebf58fc-b295-4a17-803b-ada403c83c56 Jul 06 15:33:54 devstack sudo[95792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:55 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9ae7cb0c-cfcb-4645-8840-ab9b12bfdf8b tempest-VolumesCloneNegativeTest-1791192699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-abb6edc2-d8aa-4a1e-9c51-28861f146225" returned: 0 in 0.698s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9ae7cb0c-cfcb-4645-8840-ab9b12bfdf8b tempest-VolumesCloneNegativeTest-1791192699 None] Lock "cinder-quobyte-abb6edc2-d8aa-4a1e-9c51-28861f146225" released by "delete_volume" :: held 1.674s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:55 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ee9fca22-1852-4b24-932d-41ae55470a1b tempest-GroupsV314Test-1762870362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.807s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:55 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-ee9fca22-1852-4b24-932d-41ae55470a1b tempest-GroupsV314Test-1762870362 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:33:55 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-ee9fca22-1852-4b24-932d-41ae55470a1b tempest-GroupsV314Test-1762870362 None] Delete group completed successfully. Jul 06 15:33:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c49005f2-2a81-4c1d-8f40-613e0e6b557b tempest-GroupsV314Test-1762870362 None] Acquiring lock "cinder-quobyte-eedc990b-dd57-4fab-adac-029d46a98532" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:55 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-9ae7cb0c-cfcb-4645-8840-ab9b12bfdf8b tempest-VolumesCloneNegativeTest-1791192699 None] Created reservations ['973c0c9f-e83b-4e40-8780-178c1a8df271', '563948da-ae7a-47bb-a0ec-f34110b97f31', '11d037dd-c071-4044-bbc9-26a41eb32d63', 'c4f1eace-423d-40c8-8b38-deca8c56e9fd'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:33:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c49005f2-2a81-4c1d-8f40-613e0e6b557b tempest-GroupsV314Test-1762870362 None] Lock "cinder-quobyte-eedc990b-dd57-4fab-adac-029d46a98532" acquired by "delete_volume" :: waited 0.042s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:55 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f258442-0b2b-43c6-98ce-c41f775b90b2]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c49005f2-2a81-4c1d-8f40-613e0e6b557b tempest-GroupsV314Test-1762870362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9ae7cb0c-cfcb-4645-8840-ab9b12bfdf8b tempest-VolumesCloneNegativeTest-1791192699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9ae7cb0c-cfcb-4645-8840-ab9b12bfdf8b tempest-VolumesCloneNegativeTest-1791192699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:55 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-9ae7cb0c-cfcb-4645-8840-ab9b12bfdf8b tempest-VolumesCloneNegativeTest-1791192699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:55 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-9ae7cb0c-cfcb-4645-8840-ab9b12bfdf8b tempest-VolumesCloneNegativeTest-1791192699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9ae7cb0c-cfcb-4645-8840-ab9b12bfdf8b tempest-VolumesCloneNegativeTest-1791192699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9ae7cb0c-cfcb-4645-8840-ab9b12bfdf8b tempest-VolumesCloneNegativeTest-1791192699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:55 devstack sudo[95798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:33:55 devstack sudo[95798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:55 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532 Jul 06 15:33:55 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:55 devstack sudo[95792]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6ebf58fc-b295-4a17-803b-ada403c83c56" returned: 0 in 0.755s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:55 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] <== create_volume: return (1825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:33:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:55 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59317f60-916f-458e-84fe-bec503e1e6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ebf58fc-b295-4a17-803b-ada403c83c56', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:55 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e960c7-95c0-4a98-bb38-ae29de48ba5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:55 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Volume volume-6ebf58fc-b295-4a17-803b-ada403c83c56 (6ebf58fc-b295-4a17-803b-ada403c83c56): created successfully Jul 06 15:33:55 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e960c7-95c0-4a98-bb38-ae29de48ba5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:55 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Flow 'volume_create_manager' (567e867d-6e37-47c3-834a-74bc72caf418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:33:55 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-bf8a0e42-945c-43d4-af0f-3c5fc1fd19d4 tempest-AttachVolumeNegativeTest-823541462 None] Created volume successfully. Jul 06 15:33:55 devstack sudo[95798]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9ae7cb0c-cfcb-4645-8840-ab9b12bfdf8b tempest-VolumesCloneNegativeTest-1791192699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.683s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:55 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-9ae7cb0c-cfcb-4645-8840-ab9b12bfdf8b tempest-VolumesCloneNegativeTest-1791192699 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:33:56 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-9ae7cb0c-cfcb-4645-8840-ab9b12bfdf8b tempest-VolumesCloneNegativeTest-1791192699 None] Deleted volume successfully. Jul 06 15:33:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9ae7cb0c-cfcb-4645-8840-ab9b12bfdf8b tempest-VolumesCloneNegativeTest-1791192699 None] Lock "cinder-abb6edc2-d8aa-4a1e-9c51-28861f146225-delete_volume" released by "delete_volume" :: held 2.711s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:56 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c49005f2-2a81-4c1d-8f40-613e0e6b557b tempest-GroupsV314Test-1762870362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532" returned: 0 in 0.853s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c49005f2-2a81-4c1d-8f40-613e0e6b557b tempest-GroupsV314Test-1762870362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:56 devstack sudo[95805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532 Jul 06 15:33:56 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:56 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c49005f2-2a81-4c1d-8f40-613e0e6b557b tempest-GroupsV314Test-1762870362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-eedc990b-dd57-4fab-adac-029d46a98532" returned: 0 in 0.768s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c49005f2-2a81-4c1d-8f40-613e0e6b557b tempest-GroupsV314Test-1762870362 None] Lock "cinder-quobyte-eedc990b-dd57-4fab-adac-029d46a98532" released by "delete_volume" :: held 1.689s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:56 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-c49005f2-2a81-4c1d-8f40-613e0e6b557b tempest-GroupsV314Test-1762870362 None] Created reservations ['c4a6994c-3855-4b4a-b046-c796b67a9d0e'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:33:56 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-c49005f2-2a81-4c1d-8f40-613e0e6b557b tempest-GroupsV314Test-1762870362 None] Created reservations ['bdd8ed95-3264-488e-a9d7-cd69b664f31e', 'a727802b-6087-4711-802b-bdd20569737a', '7bd5e543-5566-4df3-810d-85d418dece1b', '9313954a-765a-4fd6-bc30-ffb73e3753dc'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:33:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c49005f2-2a81-4c1d-8f40-613e0e6b557b tempest-GroupsV314Test-1762870362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c49005f2-2a81-4c1d-8f40-613e0e6b557b tempest-GroupsV314Test-1762870362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:57 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c49005f2-2a81-4c1d-8f40-613e0e6b557b tempest-GroupsV314Test-1762870362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:57 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c49005f2-2a81-4c1d-8f40-613e0e6b557b tempest-GroupsV314Test-1762870362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c49005f2-2a81-4c1d-8f40-613e0e6b557b tempest-GroupsV314Test-1762870362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c49005f2-2a81-4c1d-8f40-613e0e6b557b tempest-GroupsV314Test-1762870362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:57 devstack sudo[95811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:33:57 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:57 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c49005f2-2a81-4c1d-8f40-613e0e6b557b tempest-GroupsV314Test-1762870362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.711s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:57 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-c49005f2-2a81-4c1d-8f40-613e0e6b557b tempest-GroupsV314Test-1762870362 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:33:57 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-c49005f2-2a81-4c1d-8f40-613e0e6b557b tempest-GroupsV314Test-1762870362 None] Delete group completed successfully. Jul 06 15:33:58 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:33:58 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Flow 'volume_create_manager' (0a965c92-0f49-4c44-9c3c-2eaa2450dbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:33:58 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19df3f6c-d092-425f-bfee-49d333a664df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:58 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19df3f6c-d092-425f-bfee-49d333a664df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-340396288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e04425c0-bf1f-43ca-b903-5332c793a776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e15d300944046b3adb477fd887f042f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:59Z,use_quota=True,user_id='fe01c01018d2405bb6737dabc4cb574a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:58 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69332639-4bec-4b0a-8e8b-a6e9ea0013d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:58 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69332639-4bec-4b0a-8e8b-a6e9ea0013d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:58 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d727b78b-f980-4770-aaf0-1cdd03b58e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:58 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d727b78b-f980-4770-aaf0-1cdd03b58e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e04425c0-bf1f-43ca-b903-5332c793a776', 'volume_name': 'volume-e04425c0-bf1f-43ca-b903-5332c793a776', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:58 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deee3a8b-1f93-4009-bb6b-fdf5d4a86798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:58 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deee3a8b-1f93-4009-bb6b-fdf5d4a86798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:58 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8f2891-551e-49c8-aa36-86c3740af431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:58 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Volume e04425c0-bf1f-43ca-b903-5332c793a776: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e04425c0-bf1f-43ca-b903-5332c793a776', 'volume_size': 1} Jul 06 15:33:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:58 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-340396288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e04425c0-bf1f-43ca-b903-5332c793a776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e15d300944046b3adb477fd887f042f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:59Z,use_quota=True,user_id='fe01c01018d2405bb6737dabc4cb574a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:33:58 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Creating volume e04425c0-bf1f-43ca-b903-5332c793a776 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:33:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:58 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:58 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:58 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:33:58 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:33:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e04425c0-bf1f-43ca-b903-5332c793a776 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:58 devstack sudo[95815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e04425c0-bf1f-43ca-b903-5332c793a776 1073741824 Jul 06 15:33:58 devstack sudo[95815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-202cc089-1f10-4428-860b-f89a03d8374f req-19d4fdc5-56c0-4950-8b3f-918a2c2f93e2 tempest-AttachVolumeNegativeTest-823541462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:59 devstack sudo[95815]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e04425c0-bf1f-43ca-b903-5332c793a776 1073741824" returned: 0 in 0.912s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e04425c0-bf1f-43ca-b903-5332c793a776 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:59 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e04425c0-bf1f-43ca-b903-5332c793a776 Jul 06 15:33:59 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:00 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-da9e6ab7-fff2-46ce-b71f-4ad9fc10c850 req-ce686e0b-dd40-4f36-b196-ea6887063082 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Terminate volume connection completed successfully. Jul 06 15:34:00 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-da9e6ab7-fff2-46ce-b71f-4ad9fc10c850 req-ce686e0b-dd40-4f36-b196-ea6887063082 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Deleting attachment be1abb8b-7090-4907-a2be-251917889968. {{(pid=86148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:34:00 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e04425c0-bf1f-43ca-b903-5332c793a776" returned: 0 in 0.719s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:00 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:34:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-202cc089-1f10-4428-860b-f89a03d8374f req-19d4fdc5-56c0-4950-8b3f-918a2c2f93e2 tempest-AttachVolumeNegativeTest-823541462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.367s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:00 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8f2891-551e-49c8-aa36-86c3740af431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e04425c0-bf1f-43ca-b903-5332c793a776', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:00 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3141f883-7770-4d0d-9501-fade183f8160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:00 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95dcd95-4b22-492b-a2a8-6381082fef0e]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:34:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-202cc089-1f10-4428-860b-f89a03d8374f req-19d4fdc5-56c0-4950-8b3f-918a2c2f93e2 tempest-AttachVolumeNegativeTest-823541462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6ebf58fc-b295-4a17-803b-ada403c83c56 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:00 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Volume volume-e04425c0-bf1f-43ca-b903-5332c793a776 (e04425c0-bf1f-43ca-b903-5332c793a776): created successfully Jul 06 15:34:00 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3141f883-7770-4d0d-9501-fade183f8160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:00 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Flow 'volume_create_manager' (0a965c92-0f49-4c44-9c3c-2eaa2450dbec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:34:00 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-77e19f0a-1ead-4e4d-95a8-8a8595d9da8e tempest-VolumesNegativeTest-227588514 None] Created volume successfully. Jul 06 15:34:00 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6ebf58fc-b295-4a17-803b-ada403c83c56 Jul 06 15:34:00 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:01 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-202cc089-1f10-4428-860b-f89a03d8374f req-19d4fdc5-56c0-4950-8b3f-918a2c2f93e2 tempest-AttachVolumeNegativeTest-823541462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6ebf58fc-b295-4a17-803b-ada403c83c56" returned: 0 in 0.883s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-202cc089-1f10-4428-860b-f89a03d8374f req-19d4fdc5-56c0-4950-8b3f-918a2c2f93e2 tempest-AttachVolumeNegativeTest-823541462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.914s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-202cc089-1f10-4428-860b-f89a03d8374f req-19d4fdc5-56c0-4950-8b3f-918a2c2f93e2 tempest-AttachVolumeNegativeTest-823541462 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce', 'name': 'volume-6ebf58fc-b295-4a17-803b-ada403c83c56', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd063c1be-d827-4e0f-8692-f15c2dee493d', 'enforce_multipath': True} {{(pid=86148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:34:01 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-202cc089-1f10-4428-860b-f89a03d8374f req-19d4fdc5-56c0-4950-8b3f-918a2c2f93e2 tempest-AttachVolumeNegativeTest-823541462 None] attachment_update completed successfully. Jul 06 15:34:04 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-c5d978a0-3926-4aa5-871c-6249547c02db req-21c7da61-12b6-4cd1-a743-d3080a0d6f05 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Terminate volume connection completed successfully. Jul 06 15:34:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-c5d978a0-3926-4aa5-871c-6249547c02db req-21c7da61-12b6-4cd1-a743-d3080a0d6f05 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Deleting attachment 479cf5d1-540e-4bf0-9afc-43550d5b07cc. {{(pid=86148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:34:07 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-7ae80e1a-a1e9-4862-99a1-af94ea5b46e1 req-962eac22-1571-40b6-a9de-0bb0b4a068ad tempest-AttachVolumeNegativeTest-823541462 None] Terminate volume connection completed successfully. Jul 06 15:34:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-7ae80e1a-a1e9-4862-99a1-af94ea5b46e1 req-962eac22-1571-40b6-a9de-0bb0b4a068ad tempest-AttachVolumeNegativeTest-823541462 None] Deleting attachment d063c1be-d827-4e0f-8692-f15c2dee493d. {{(pid=86148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:34:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-31ea404e-bcc3-48fa-ab3f-fb361b586475 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Acquiring lock "cinder-14336ae6-5e39-4123-9de6-9cfafd231a05-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:34:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-31ea404e-bcc3-48fa-ab3f-fb361b586475 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Lock "cinder-14336ae6-5e39-4123-9de6-9cfafd231a05-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:34:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-31ea404e-bcc3-48fa-ab3f-fb361b586475 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Acquiring lock "cinder-quobyte-14336ae6-5e39-4123-9de6-9cfafd231a05" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:34:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-31ea404e-bcc3-48fa-ab3f-fb361b586475 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Lock "cinder-quobyte-14336ae6-5e39-4123-9de6-9cfafd231a05" acquired by "delete_volume" :: waited 0.022s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:34:14 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5fddc4-4424-4d37-8906-765adab3397a]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:34:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-31ea404e-bcc3-48fa-ab3f-fb361b586475 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-14336ae6-5e39-4123-9de6-9cfafd231a05 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:14 devstack sudo[95956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-14336ae6-5e39-4123-9de6-9cfafd231a05 Jul 06 15:34:14 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:15 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-31ea404e-bcc3-48fa-ab3f-fb361b586475 tempest-TestServerVolumeAttachmentScenario-2147023309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-14336ae6-5e39-4123-9de6-9cfafd231a05" returned: 0 in 0.880s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-31ea404e-bcc3-48fa-ab3f-fb361b586475 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-14336ae6-5e39-4123-9de6-9cfafd231a05 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:15 devstack sudo[95968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-14336ae6-5e39-4123-9de6-9cfafd231a05 Jul 06 15:34:15 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:16 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-31ea404e-bcc3-48fa-ab3f-fb361b586475 tempest-TestServerVolumeAttachmentScenario-2147023309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-14336ae6-5e39-4123-9de6-9cfafd231a05" returned: 0 in 0.837s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:16 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-31ea404e-bcc3-48fa-ab3f-fb361b586475 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Lock "cinder-quobyte-14336ae6-5e39-4123-9de6-9cfafd231a05" released by "delete_volume" :: held 1.819s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:16 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-31ea404e-bcc3-48fa-ab3f-fb361b586475 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Created reservations ['5f4ea867-8ecc-4b33-803a-4cffa25efd40', '3cb7873e-4ca6-46e8-b070-63b08ceae8b1', 'bc89bc37-854b-4d16-bfb9-6721dcff51de', '81faa1c7-d283-499e-8b6f-657849d4dc30'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:34:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-31ea404e-bcc3-48fa-ab3f-fb361b586475 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-31ea404e-bcc3-48fa-ab3f-fb361b586475 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:16 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-31ea404e-bcc3-48fa-ab3f-fb361b586475 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:34:16 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-31ea404e-bcc3-48fa-ab3f-fb361b586475 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:34:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-31ea404e-bcc3-48fa-ab3f-fb361b586475 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-31ea404e-bcc3-48fa-ab3f-fb361b586475 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:16 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:34:16 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:16 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ea591d91-4356-429e-9b7b-6b23436a1c0c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Acquiring lock "cinder-a2a3019a-7e8a-481e-a4e3-775d4df59a99-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:34:16 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ea591d91-4356-429e-9b7b-6b23436a1c0c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Lock "cinder-a2a3019a-7e8a-481e-a4e3-775d4df59a99-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:34:17 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ea591d91-4356-429e-9b7b-6b23436a1c0c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Acquiring lock "cinder-quobyte-a2a3019a-7e8a-481e-a4e3-775d4df59a99" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:34:17 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ea591d91-4356-429e-9b7b-6b23436a1c0c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Lock "cinder-quobyte-a2a3019a-7e8a-481e-a4e3-775d4df59a99" acquired by "delete_volume" :: waited 0.043s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:34:17 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f82d88-841d-4b2c-acd3-f1188bbf7ee8]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:34:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ea591d91-4356-429e-9b7b-6b23436a1c0c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a2a3019a-7e8a-481e-a4e3-775d4df59a99 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:17 devstack sudo[95994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a2a3019a-7e8a-481e-a4e3-775d4df59a99 Jul 06 15:34:17 devstack sudo[95994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:18 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-31ea404e-bcc3-48fa-ab3f-fb361b586475 tempest-TestServerVolumeAttachmentScenario-2147023309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.432s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:18 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-31ea404e-bcc3-48fa-ab3f-fb361b586475 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:34:18 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-31ea404e-bcc3-48fa-ab3f-fb361b586475 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Deleted volume successfully. Jul 06 15:34:18 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-31ea404e-bcc3-48fa-ab3f-fb361b586475 tempest-TestServerVolumeAttachmentScenario-2147023309 None] Lock "cinder-14336ae6-5e39-4123-9de6-9cfafd231a05-delete_volume" released by "delete_volume" :: held 3.613s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:18 devstack sudo[95994]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ea591d91-4356-429e-9b7b-6b23436a1c0c tempest-TestServerVolumeAttachmentScenario-2147023309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a2a3019a-7e8a-481e-a4e3-775d4df59a99" returned: 0 in 1.441s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ea591d91-4356-429e-9b7b-6b23436a1c0c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a2a3019a-7e8a-481e-a4e3-775d4df59a99 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:18 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a2a3019a-7e8a-481e-a4e3-775d4df59a99 Jul 06 15:34:18 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:19 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ea591d91-4356-429e-9b7b-6b23436a1c0c tempest-TestServerVolumeAttachmentScenario-2147023309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a2a3019a-7e8a-481e-a4e3-775d4df59a99" returned: 0 in 1.246s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ea591d91-4356-429e-9b7b-6b23436a1c0c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Lock "cinder-quobyte-a2a3019a-7e8a-481e-a4e3-775d4df59a99" released by "delete_volume" :: held 2.800s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:20 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-ea591d91-4356-429e-9b7b-6b23436a1c0c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Created reservations ['c8472eec-46cc-4f02-a243-acfbc4b3b3ae', '62c99fcb-ea2e-4fb9-a6cf-8081eb036c49', '04ba31f3-4aea-4f2f-81de-8c4673b359bd', 'f8e68ea4-7bc0-4698-be31-0541773e28c0'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:34:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ea591d91-4356-429e-9b7b-6b23436a1c0c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ea591d91-4356-429e-9b7b-6b23436a1c0c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ea591d91-4356-429e-9b7b-6b23436a1c0c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:34:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ea591d91-4356-429e-9b7b-6b23436a1c0c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:34:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ea591d91-4356-429e-9b7b-6b23436a1c0c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ea591d91-4356-429e-9b7b-6b23436a1c0c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:20 devstack sudo[96004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:34:20 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:21 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ea591d91-4356-429e-9b7b-6b23436a1c0c tempest-TestServerVolumeAttachmentScenario-2147023309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.990s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:21 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-ea591d91-4356-429e-9b7b-6b23436a1c0c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:34:21 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-ea591d91-4356-429e-9b7b-6b23436a1c0c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Deleted volume successfully. Jul 06 15:34:21 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ea591d91-4356-429e-9b7b-6b23436a1c0c tempest-TestServerVolumeAttachmentScenario-2147023309 None] Lock "cinder-a2a3019a-7e8a-481e-a4e3-775d4df59a99-delete_volume" released by "delete_volume" :: held 4.188s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:30 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:UPDATE=62,cinder:SELECT=56,cinder:INSERT=16,cinder:DELETE=3 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:34:31 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:INSERT=12,cinder:UPDATE=78,cinder:SELECT=65,cinder:DELETE=5 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:34:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f0976676-e9a1-44b6-a106-8b6df50347a6 tempest-VolumesNegativeTest-227588514 None] Acquiring lock "cinder-e04425c0-bf1f-43ca-b903-5332c793a776-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:34:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f0976676-e9a1-44b6-a106-8b6df50347a6 tempest-VolumesNegativeTest-227588514 None] Lock "cinder-e04425c0-bf1f-43ca-b903-5332c793a776-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:34:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f0976676-e9a1-44b6-a106-8b6df50347a6 tempest-VolumesNegativeTest-227588514 None] Acquiring lock "cinder-quobyte-e04425c0-bf1f-43ca-b903-5332c793a776" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:34:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f0976676-e9a1-44b6-a106-8b6df50347a6 tempest-VolumesNegativeTest-227588514 None] Lock "cinder-quobyte-e04425c0-bf1f-43ca-b903-5332c793a776" acquired by "delete_volume" :: waited 0.029s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:34:36 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5aad9c8-8862-4ebc-a897-4080f44a1da3]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:34:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f0976676-e9a1-44b6-a106-8b6df50347a6 tempest-VolumesNegativeTest-227588514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e04425c0-bf1f-43ca-b903-5332c793a776 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:36 devstack sudo[96135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e04425c0-bf1f-43ca-b903-5332c793a776 Jul 06 15:34:36 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:37 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f0976676-e9a1-44b6-a106-8b6df50347a6 tempest-VolumesNegativeTest-227588514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e04425c0-bf1f-43ca-b903-5332c793a776" returned: 0 in 1.080s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f0976676-e9a1-44b6-a106-8b6df50347a6 tempest-VolumesNegativeTest-227588514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e04425c0-bf1f-43ca-b903-5332c793a776 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:37 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e04425c0-bf1f-43ca-b903-5332c793a776 Jul 06 15:34:37 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:34:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:34:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:34:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:38 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:34:38 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:38 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f0976676-e9a1-44b6-a106-8b6df50347a6 tempest-VolumesNegativeTest-227588514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e04425c0-bf1f-43ca-b903-5332c793a776" returned: 0 in 1.005s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f0976676-e9a1-44b6-a106-8b6df50347a6 tempest-VolumesNegativeTest-227588514 None] Lock "cinder-quobyte-e04425c0-bf1f-43ca-b903-5332c793a776" released by "delete_volume" :: held 2.172s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:38 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-f0976676-e9a1-44b6-a106-8b6df50347a6 tempest-VolumesNegativeTest-227588514 None] Created reservations ['f2f9ff08-9684-48f0-ae8e-f4bb9cc9db32', 'ff06c296-8b74-4be8-9863-5e4f04d2ce77', '571227ad-3554-4e74-a5c6-84775623c263', 'ec31867a-75a1-41c1-990b-1164c46c9bb3'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:34:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f0976676-e9a1-44b6-a106-8b6df50347a6 tempest-VolumesNegativeTest-227588514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f0976676-e9a1-44b6-a106-8b6df50347a6 tempest-VolumesNegativeTest-227588514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f0976676-e9a1-44b6-a106-8b6df50347a6 tempest-VolumesNegativeTest-227588514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:34:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f0976676-e9a1-44b6-a106-8b6df50347a6 tempest-VolumesNegativeTest-227588514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:34:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f0976676-e9a1-44b6-a106-8b6df50347a6 tempest-VolumesNegativeTest-227588514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f0976676-e9a1-44b6-a106-8b6df50347a6 tempest-VolumesNegativeTest-227588514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:38 devstack sudo[96175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:34:38 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:39 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.269s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:34:39 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager._thread_info {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:34:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread count: 28 {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:34:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread info: [<_MainThread(MainThread, started 124857273856128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:34:39 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f0976676-e9a1-44b6-a106-8b6df50347a6 tempest-VolumesNegativeTest-227588514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.043s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-f0976676-e9a1-44b6-a106-8b6df50347a6 tempest-VolumesNegativeTest-227588514 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:34:39 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-f0976676-e9a1-44b6-a106-8b6df50347a6 tempest-VolumesNegativeTest-227588514 None] Deleted volume successfully. Jul 06 15:34:39 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f0976676-e9a1-44b6-a106-8b6df50347a6 tempest-VolumesNegativeTest-227588514 None] Lock "cinder-e04425c0-bf1f-43ca-b903-5332c793a776-delete_volume" released by "delete_volume" :: held 3.652s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:46 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:34:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Flow 'volume_create_manager' (a0405846-3949-4884-b615-ed58a44f0f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:34:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f1765e6-76b0-4f4f-a0c6-77933a03372b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f1765e6-76b0-4f4f-a0c6-77933a03372b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1676153089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4524f7d4-984a-440e-ae11-43597d5bb401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddc196b65684e7ebf87e52fb317dac5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:46Z,use_quota=True,user_id='22206ded1bc94ded93862912897bdd2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44ecc04e-740e-4fb9-85e7-d1fb597e124e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44ecc04e-740e-4fb9-85e7-d1fb597e124e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b203a8-b4da-410d-afc5-e22dcbe4ac89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:46 devstack cinder-volume[86148]: DEBUG cinder.image.glance [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Creating Keystone auth plugin from conf {{(pid=86148) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 15:34:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b203a8-b4da-410d-afc5-e22dcbe4ac89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4524f7d4-984a-440e-ae11-43597d5bb401', 'volume_name': 'volume-4524f7d4-984a-440e-ae11-43597d5bb401', 'volume_size': 1, 'image_id': 'aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2cea8b96599e40e1978f302796eb3239', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'created_at': datetime.datetime(2026, 7, 6, 13, 18, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 18, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293889d8-0259-424b-89a0-9a5ab6d5db03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293889d8-0259-424b-89a0-9a5ab6d5db03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754e2530-54c9-48c5-a9e8-85e389c7c2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:46 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Volume 4524f7d4-984a-440e-ae11-43597d5bb401: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4524f7d4-984a-440e-ae11-43597d5bb401', 'volume_size': 1, 'image_id': 'aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2cea8b96599e40e1978f302796eb3239', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'created_at': datetime.datetime(2026, 7, 6, 13, 18, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 18, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 15:34:46 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Trying to clone 4524f7d4-984a-440e-ae11-43597d5bb401 from image aab1d6f3-bc8c-4137-9f0e-54346f68c452 at location (None, [{'url': 'file:///opt/stack/data/glance/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'metadata': {}}]). {{(pid=86148) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 15:34:47 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_exwcjuu5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86148) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 15:34:47 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Image download 20.69 MB at 20.69 MB/s Jul 06 15:34:47 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ac91d6-1960-4bb7-926a-23485cdd62c4]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:34:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_exwcjuu5devstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:47 devstack sudo[96180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_exwcjuu5devstack@QuobyteHD Jul 06 15:34:47 devstack sudo[96180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:48 devstack sudo[96180]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_exwcjuu5devstack@QuobyteHD" returned: 0 in 1.103s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:48 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Temporary image aab1d6f3-bc8c-4137-9f0e-54346f68c452 is fetched for user 22206ded1bc94ded93862912897bdd2b. {{(pid=86148) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 15:34:48 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4554cb-a7a8-425e-9874-802db4cc5a7b]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:34:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_exwcjuu5devstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:48 devstack sudo[96185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_exwcjuu5devstack@QuobyteHD Jul 06 15:34:48 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:49 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_exwcjuu5devstack@QuobyteHD" returned: 0 in 1.150s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1676153089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4524f7d4-984a-440e-ae11-43597d5bb401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddc196b65684e7ebf87e52fb317dac5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:46Z,use_quota=True,user_id='22206ded1bc94ded93862912897bdd2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:34:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Creating volume 4524f7d4-984a-440e-ae11-43597d5bb401 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:34:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:34:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:34:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:34:49 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:34:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:49 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401 1073741824 Jul 06 15:34:49 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:50 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401 1073741824" returned: 0 in 1.283s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:50 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401 Jul 06 15:34:50 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:51 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401" returned: 0 in 0.770s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] <== create_volume: return (2118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:34:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.123s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:51 devstack cinder-volume[86148]: DEBUG cinder.volume.volume_utils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Attempting download of aab1d6f3-bc8c-4137-9f0e-54346f68c452 ((None, [{'url': 'file:///opt/stack/data/glance/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'metadata': {}}])) to volume 4524f7d4-984a-440e-ae11-43597d5bb401. {{(pid=86148) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 15:34:51 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17f0cb1-ba5f-4477-91bb-79f2f5210aef]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:34:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aab1d6f3-bc8c-4137-9f0e-54346f68c452_pcs_04ns {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:51 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aab1d6f3-bc8c-4137-9f0e-54346f68c452_pcs_04ns Jul 06 15:34:51 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:52 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aab1d6f3-bc8c-4137-9f0e-54346f68c452_pcs_04ns" returned: 0 in 0.910s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aab1d6f3-bc8c-4137-9f0e-54346f68c452_pcs_04ns {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:52 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aab1d6f3-bc8c-4137-9f0e-54346f68c452_pcs_04ns Jul 06 15:34:52 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:53 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aab1d6f3-bc8c-4137-9f0e-54346f68c452_pcs_04ns" returned: 1 in 0.777s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aab1d6f3-bc8c-4137-9f0e-54346f68c452_pcs_04ns' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:34:53 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[3699c522-0c62-499b-9e4a-e972081c8efb]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:34:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_exwcjuu5devstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:53 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_exwcjuu5devstack@QuobyteHD Jul 06 15:34:53 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:54 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_exwcjuu5devstack@QuobyteHD" returned: 0 in 0.989s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:54 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] aab1d6f3-bc8c-4137-9f0e-54346f68c452 was qcow2, converting to raw {{(pid=86148) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 15:34:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_exwcjuu5devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:54 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_exwcjuu5devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401 Jul 06 15:34:54 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:56 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_exwcjuu5devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401" returned: 0 in 2.365s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:56 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_exwcjuu5devstack@QuobyteHD, size 112.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401 {{(pid=86148) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:34:56 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Converted 112.00 MB image at 47.34 MB/s Jul 06 15:34:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:56 devstack sudo[96263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401 1G Jul 06 15:34:56 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:57 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401 1G" returned: 0 in 0.788s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:57 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[161d77ef-a010-42eb-b9b5-465c820710cb]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:34:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:57 devstack sudo[96268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401 Jul 06 15:34:57 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:58 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401" returned: 0 in 0.816s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:58 devstack sudo[96272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401 Jul 06 15:34:58 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:59 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401" returned: 1 in 0.988s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:34:59 devstack cinder-volume[86148]: DEBUG cinder.volume.volume_utils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Downloaded image aab1d6f3-bc8c-4137-9f0e-54346f68c452 ((None, [{'url': 'file:///opt/stack/data/glance/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'metadata': {}}])) to volume 4524f7d4-984a-440e-ae11-43597d5bb401 successfully. {{(pid=86148) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 15:34:59 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Temporary image aab1d6f3-bc8c-4137-9f0e-54346f68c452 for user 22206ded1bc94ded93862912897bdd2b is deleted. {{(pid=86148) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 15:34:59 devstack cinder-volume[86148]: DEBUG cinder.volume.volume_utils [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Marking volume 4524f7d4-984a-440e-ae11-43597d5bb401 as bootable. {{(pid=86148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 15:34:59 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Copying metadata from image aab1d6f3-bc8c-4137-9f0e-54346f68c452 to 4524f7d4-984a-440e-ae11-43597d5bb401. {{(pid=86148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 15:34:59 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Creating volume glance metadata for volume 4524f7d4-984a-440e-ae11-43597d5bb401 backed by image aab1d6f3-bc8c-4137-9f0e-54346f68c452 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86148) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 15:34:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754e2530-54c9-48c5-a9e8-85e389c7c2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4524f7d4-984a-440e-ae11-43597d5bb401', 'volume_size': 1, 'image_id': 'aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2cea8b96599e40e1978f302796eb3239', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'created_at': datetime.datetime(2026, 7, 6, 13, 18, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 18, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe8bb4a0-cebd-42a5-b61c-2e68414a589e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:59 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Volume volume-4524f7d4-984a-440e-ae11-43597d5bb401 (4524f7d4-984a-440e-ae11-43597d5bb401): created successfully Jul 06 15:34:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe8bb4a0-cebd-42a5-b61c-2e68414a589e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Flow 'volume_create_manager' (a0405846-3949-4884-b615-ed58a44f0f49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:34:59 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-643de618-36a9-411c-8a1a-955f12616d69 tempest-VolumesImageMetadata-1684720975 None] Created volume successfully. Jul 06 15:35:00 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-68a258a9-e057-4c72-becf-a3a5939041c1 tempest-VolumesImageMetadata-1684720975 None] Acquiring lock "cinder-4524f7d4-984a-440e-ae11-43597d5bb401-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:00 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-68a258a9-e057-4c72-becf-a3a5939041c1 tempest-VolumesImageMetadata-1684720975 None] Lock "cinder-4524f7d4-984a-440e-ae11-43597d5bb401-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:00 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-68a258a9-e057-4c72-becf-a3a5939041c1 tempest-VolumesImageMetadata-1684720975 None] Acquiring lock "cinder-quobyte-4524f7d4-984a-440e-ae11-43597d5bb401" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:00 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-68a258a9-e057-4c72-becf-a3a5939041c1 tempest-VolumesImageMetadata-1684720975 None] Lock "cinder-quobyte-4524f7d4-984a-440e-ae11-43597d5bb401" acquired by "delete_volume" :: waited 0.022s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:01 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[5379f286-5667-4ac8-9775-012815d35fab]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-68a258a9-e057-4c72-becf-a3a5939041c1 tempest-VolumesImageMetadata-1684720975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:01 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401 Jul 06 15:35:01 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:02 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-68a258a9-e057-4c72-becf-a3a5939041c1 tempest-VolumesImageMetadata-1684720975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401" returned: 0 in 1.179s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-68a258a9-e057-4c72-becf-a3a5939041c1 tempest-VolumesImageMetadata-1684720975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:02 devstack sudo[96285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401 Jul 06 15:35:02 devstack sudo[96285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:03 devstack sudo[96285]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-68a258a9-e057-4c72-becf-a3a5939041c1 tempest-VolumesImageMetadata-1684720975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401" returned: 1 in 0.891s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-68a258a9-e057-4c72-becf-a3a5939041c1 tempest-VolumesImageMetadata-1684720975 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:35:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-68a258a9-e057-4c72-becf-a3a5939041c1 tempest-VolumesImageMetadata-1684720975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:03 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401 Jul 06 15:35:03 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:03 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:35:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Flow 'volume_create_manager' (c0fbbd11-d53b-4674-91bb-eb0849f2ecd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d141bf-335c-4c56-80cf-86119a0fb5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d141bf-335c-4c56-80cf-86119a0fb5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-830077674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b015a3b8-21ab-4bbc-85fb-1e515a5dff69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b2df85079b34aacbc4881185ed9f331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:04Z,use_quota=True,user_id='474277430b324c4c95f5f6c06a88054f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ed7994-465b-493e-9c08-3f2eceed5984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ed7994-465b-493e-9c08-3f2eceed5984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e925cd-cb2c-435f-8c7c-46432d8ae081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e925cd-cb2c-435f-8c7c-46432d8ae081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b015a3b8-21ab-4bbc-85fb-1e515a5dff69', 'volume_name': 'volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799509dd-1fe0-4e19-b258-8bc7c39da63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799509dd-1fe0-4e19-b258-8bc7c39da63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1474f55-165e-4244-a4e2-ccabd43edb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:03 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Volume b015a3b8-21ab-4bbc-85fb-1e515a5dff69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69', 'volume_size': 1} Jul 06 15:35:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:03 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-830077674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b015a3b8-21ab-4bbc-85fb-1e515a5dff69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b2df85079b34aacbc4881185ed9f331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:04Z,use_quota=True,user_id='474277430b324c4c95f5f6c06a88054f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:35:03 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Creating volume b015a3b8-21ab-4bbc-85fb-1e515a5dff69 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:35:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:03 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:03 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:03 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:35:03 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:35:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:03 devstack sudo[96294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69 1073741824 Jul 06 15:35:03 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:04 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-68a258a9-e057-4c72-becf-a3a5939041c1 tempest-VolumesImageMetadata-1684720975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4524f7d4-984a-440e-ae11-43597d5bb401" returned: 0 in 0.900s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:04 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-68a258a9-e057-4c72-becf-a3a5939041c1 tempest-VolumesImageMetadata-1684720975 None] Lock "cinder-quobyte-4524f7d4-984a-440e-ae11-43597d5bb401" released by "delete_volume" :: held 3.065s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:04 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-68a258a9-e057-4c72-becf-a3a5939041c1 tempest-VolumesImageMetadata-1684720975 None] Created reservations ['63e54a8c-4a89-4dc2-853c-9855a0466bbb', '90ce0e49-e677-409f-a3d5-ef5add5f2836', 'eb52305d-9678-46f4-ac21-db14f0ba3268', '3b393eca-e871-4986-8b83-b4270460cb7f'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:35:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-68a258a9-e057-4c72-becf-a3a5939041c1 tempest-VolumesImageMetadata-1684720975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-68a258a9-e057-4c72-becf-a3a5939041c1 tempest-VolumesImageMetadata-1684720975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:04 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-68a258a9-e057-4c72-becf-a3a5939041c1 tempest-VolumesImageMetadata-1684720975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:04 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-68a258a9-e057-4c72-becf-a3a5939041c1 tempest-VolumesImageMetadata-1684720975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-68a258a9-e057-4c72-becf-a3a5939041c1 tempest-VolumesImageMetadata-1684720975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-68a258a9-e057-4c72-becf-a3a5939041c1 tempest-VolumesImageMetadata-1684720975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:04 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:35:04 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:04 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:35:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Flow 'volume_create_manager' (b34f400b-a29e-420b-b3b8-c4178b53a58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e63c5de-cbe0-44ed-b6d9-b2b56632e19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e63c5de-cbe0-44ed-b6d9-b2b56632e19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1141564384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c568390-9d78-48fe-845c-2f90ff72701b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbfa0829fd58449a877989117e0038c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:04Z,use_quota=True,user_id='9963f3ddbdf04eac866d7d1a66ca81c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b7946b-5cb6-46b3-a261-1c8496488203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b7946b-5cb6-46b3-a261-1c8496488203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01046e22-e7fc-4485-a987-0bf378c017aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01046e22-e7fc-4485-a987-0bf378c017aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c568390-9d78-48fe-845c-2f90ff72701b', 'volume_name': 'volume-5c568390-9d78-48fe-845c-2f90ff72701b', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c37b368d-8284-4c26-a965-95f830f2ea9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c37b368d-8284-4c26-a965-95f830f2ea9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f07f669-5446-4e14-be28-3b859f06f778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:04 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Volume 5c568390-9d78-48fe-845c-2f90ff72701b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c568390-9d78-48fe-845c-2f90ff72701b', 'volume_size': 1} Jul 06 15:35:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:04 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:35:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Flow 'volume_create_manager' (266a54c1-517f-4ae5-b396-0aa0b4fd99af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70cee5c8-e2c7-4998-b69c-e95885accd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70cee5c8-e2c7-4998-b69c-e95885accd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1431673099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d899e854-b24b-4aa4-9cba-6a52b7ce6d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c45904797864f8493a520651b327e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:05Z,use_quota=True,user_id='309365767b814ec0840ec934b3ec107c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67e2642-1912-4d2e-8fa3-351e4aa5cc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67e2642-1912-4d2e-8fa3-351e4aa5cc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f3bc1de-3f6f-48c6-8627-1bf8a231a915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f3bc1de-3f6f-48c6-8627-1bf8a231a915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd899e854-b24b-4aa4-9cba-6a52b7ce6d10', 'volume_name': 'volume-d899e854-b24b-4aa4-9cba-6a52b7ce6d10', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe6ad8b5-67f8-4d7c-ae8a-f247a6ad5983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe6ad8b5-67f8-4d7c-ae8a-f247a6ad5983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23b8419f-9eee-46a2-9aec-56ad11fa5f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:05 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Volume d899e854-b24b-4aa4-9cba-6a52b7ce6d10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d899e854-b24b-4aa4-9cba-6a52b7ce6d10', 'volume_size': 1} Jul 06 15:35:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:05 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-68a258a9-e057-4c72-becf-a3a5939041c1 tempest-VolumesImageMetadata-1684720975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.842s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:05 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-68a258a9-e057-4c72-becf-a3a5939041c1 tempest-VolumesImageMetadata-1684720975 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:35:05 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-68a258a9-e057-4c72-becf-a3a5939041c1 tempest-VolumesImageMetadata-1684720975 None] Deleted volume successfully. Jul 06 15:35:05 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:05 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-68a258a9-e057-4c72-becf-a3a5939041c1 tempest-VolumesImageMetadata-1684720975 None] Lock "cinder-4524f7d4-984a-440e-ae11-43597d5bb401-delete_volume" released by "delete_volume" :: held 4.329s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69 1073741824" returned: 0 in 1.506s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:05 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69 Jul 06 15:35:05 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:06 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69" returned: 0 in 0.784s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:06 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] <== create_volume: return (2355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:35:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.358s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.400s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:06 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1141564384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c568390-9d78-48fe-845c-2f90ff72701b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbfa0829fd58449a877989117e0038c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:04Z,use_quota=True,user_id='9963f3ddbdf04eac866d7d1a66ca81c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:35:06 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Creating volume 5c568390-9d78-48fe-845c-2f90ff72701b {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:35:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:06 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:06 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:06 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:35:06 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:35:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:06 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b 1073741824 Jul 06 15:35:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1474f55-165e-4244-a4e2-ccabd43edb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:06 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f486dc6e-a35c-4b24-bc1e-b1a19ff43ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:06 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Volume volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69 (b015a3b8-21ab-4bbc-85fb-1e515a5dff69): created successfully Jul 06 15:35:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f486dc6e-a35c-4b24-bc1e-b1a19ff43ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Flow 'volume_create_manager' (c0fbbd11-d53b-4674-91bb-eb0849f2ecd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:06 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-67271c03-1187-45be-a6f6-589fbe6c577e tempest-VolumesSnapshotTestJSON-488916833 None] Created volume successfully. Jul 06 15:35:07 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b 1073741824" returned: 0 in 1.141s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c9bcd9da-0f0d-4b49-b9f3-fbd8846537e1 tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:07 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b Jul 06 15:35:07 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:08 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b" returned: 0 in 0.753s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] <== create_volume: return (2002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:35:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.038s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1431673099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d899e854-b24b-4aa4-9cba-6a52b7ce6d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c45904797864f8493a520651b327e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:05Z,use_quota=True,user_id='309365767b814ec0840ec934b3ec107c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:35:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Creating volume d899e854-b24b-4aa4-9cba-6a52b7ce6d10 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:35:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:35:08 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:35:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d899e854-b24b-4aa4-9cba-6a52b7ce6d10 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:08 devstack sudo[96321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d899e854-b24b-4aa4-9cba-6a52b7ce6d10 1073741824 Jul 06 15:35:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f07f669-5446-4e14-be28-3b859f06f778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c568390-9d78-48fe-845c-2f90ff72701b', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:08 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed6e2ad-0cea-4a5a-b56a-31fd0c99afaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:08 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Volume volume-5c568390-9d78-48fe-845c-2f90ff72701b (5c568390-9d78-48fe-845c-2f90ff72701b): created successfully Jul 06 15:35:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed6e2ad-0cea-4a5a-b56a-31fd0c99afaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Flow 'volume_create_manager' (b34f400b-a29e-420b-b3b8-c4178b53a58e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:08 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-51fd5c53-66c4-4ad6-8a85-dc927f7205bb tempest-TestStampPattern-150571277 None] Created volume successfully. Jul 06 15:35:08 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d899e854-b24b-4aa4-9cba-6a52b7ce6d10 1073741824" returned: 0 in 0.882s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d899e854-b24b-4aa4-9cba-6a52b7ce6d10 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:09 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d899e854-b24b-4aa4-9cba-6a52b7ce6d10 Jul 06 15:35:09 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:09 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d899e854-b24b-4aa4-9cba-6a52b7ce6d10" returned: 0 in 0.679s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:35:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c9bcd9da-0f0d-4b49-b9f3-fbd8846537e1 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.350s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-c9bcd9da-0f0d-4b49-b9f3-fbd8846537e1 tempest-VolumesSnapshotTestJSON-488916833 None] Creating offline snapshot b773f70a-421a-49dc-b505-f98302cf26e1 of volume b015a3b8-21ab-4bbc-85fb-1e515a5dff69 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:35:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23b8419f-9eee-46a2-9aec-56ad11fa5f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d899e854-b24b-4aa4-9cba-6a52b7ce6d10', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f96377a8-d683-41d3-a6cf-610b2c36eeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:09 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d698fc7-82d9-449a-8697-8b8412361b20]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c9bcd9da-0f0d-4b49-b9f3-fbd8846537e1 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:09 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Volume volume-d899e854-b24b-4aa4-9cba-6a52b7ce6d10 (d899e854-b24b-4aa4-9cba-6a52b7ce6d10): created successfully Jul 06 15:35:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f96377a8-d683-41d3-a6cf-610b2c36eeb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Flow 'volume_create_manager' (266a54c1-517f-4ae5-b396-0aa0b4fd99af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:09 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-17202bbb-bf22-4737-a6bf-d282f1faf228 tempest-AttachVolumeNegativeTest-823541462 None] Created volume successfully. Jul 06 15:35:09 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69 Jul 06 15:35:09 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:10 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:35:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Flow 'volume_create_manager' (14c7b481-f6cd-407f-9002-164db788d459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:10 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bead21d6-c9fa-4466-a6be-aab0ff55ff40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c9bcd9da-0f0d-4b49-b9f3-fbd8846537e1 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69" returned: 0 in 0.843s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c9bcd9da-0f0d-4b49-b9f3-fbd8846537e1 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69.b773f70a-421a-49dc-b505-f98302cf26e1 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bead21d6-c9fa-4466-a6be-aab0ff55ff40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-868670439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=948e4d55-1733-4f81-8f7e-da48124da41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7760d3201776451bb1acbcc22eb9b4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:11Z,use_quota=True,user_id='88e0b97e7a604fb1857f0cf0e0bf9438',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:10 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69.b773f70a-421a-49dc-b505-f98302cf26e1 1G Jul 06 15:35:10 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54f2d3b-0dc9-4205-8e60-fe2aa138ad79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54f2d3b-0dc9-4205-8e60-fe2aa138ad79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913d9dfd-fd98-45d2-a9e0-d6b1db47ae41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913d9dfd-fd98-45d2-a9e0-d6b1db47ae41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '948e4d55-1733-4f81-8f7e-da48124da41b', 'volume_name': 'volume-948e4d55-1733-4f81-8f7e-da48124da41b', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (791d87c9-4afe-4d63-a8a8-12b7b9a3050b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (791d87c9-4afe-4d63-a8a8-12b7b9a3050b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66874387-b76b-4036-b60a-baec97806698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:10 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Volume 948e4d55-1733-4f81-8f7e-da48124da41b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-948e4d55-1733-4f81-8f7e-da48124da41b', 'volume_size': 1} Jul 06 15:35:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:11 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c9bcd9da-0f0d-4b49-b9f3-fbd8846537e1 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69.b773f70a-421a-49dc-b505-f98302cf26e1 1G" returned: 0 in 0.900s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c9bcd9da-0f0d-4b49-b9f3-fbd8846537e1 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69.b773f70a-421a-49dc-b505-f98302cf26e1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:11 devstack sudo[96346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69.b773f70a-421a-49dc-b505-f98302cf26e1 Jul 06 15:35:11 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:12 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c9bcd9da-0f0d-4b49-b9f3-fbd8846537e1 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69.b773f70a-421a-49dc-b505-f98302cf26e1" returned: 0 in 0.926s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:12 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-c9bcd9da-0f0d-4b49-b9f3-fbd8846537e1 tempest-VolumesSnapshotTestJSON-488916833 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69.b773f70a-421a-49dc-b505-f98302cf26e1 is being set with open permissions: ugo+rw Jul 06 15:35:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c9bcd9da-0f0d-4b49-b9f3-fbd8846537e1 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69.b773f70a-421a-49dc-b505-f98302cf26e1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:12 devstack sudo[96352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69.b773f70a-421a-49dc-b505-f98302cf26e1 Jul 06 15:35:12 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:13 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c9bcd9da-0f0d-4b49-b9f3-fbd8846537e1 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69.b773f70a-421a-49dc-b505-f98302cf26e1" returned: 0 in 0.892s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c9bcd9da-0f0d-4b49-b9f3-fbd8846537e1 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:13 devstack sudo[96377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69.info Jul 06 15:35:13 devstack sudo[96377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-bbeb8a57-58d3-4469-8913-2934d3c85910 req-7ba263d8-f9d3-4f9d-bb98-f4edf1b14a59 tempest-AttachVolumeNegativeTest-823541462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:14 devstack sudo[96377]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c9bcd9da-0f0d-4b49-b9f3-fbd8846537e1 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69.info" returned: 0 in 0.675s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:14 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-c9bcd9da-0f0d-4b49-b9f3-fbd8846537e1 tempest-VolumesSnapshotTestJSON-488916833 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69.info is being set with open permissions: ugo+rw Jul 06 15:35:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c9bcd9da-0f0d-4b49-b9f3-fbd8846537e1 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:14 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69.info Jul 06 15:35:14 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:14 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c9bcd9da-0f0d-4b49-b9f3-fbd8846537e1 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69.info" returned: 0 in 0.636s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c9bcd9da-0f0d-4b49-b9f3-fbd8846537e1 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.015s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.046s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-868670439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=948e4d55-1733-4f81-8f7e-da48124da41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7760d3201776451bb1acbcc22eb9b4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:11Z,use_quota=True,user_id='88e0b97e7a604fb1857f0cf0e0bf9438',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:35:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Creating volume 948e4d55-1733-4f81-8f7e-da48124da41b {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:35:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:35:14 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:35:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-948e4d55-1733-4f81-8f7e-da48124da41b 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:14 devstack sudo[96387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-948e4d55-1733-4f81-8f7e-da48124da41b 1073741824 Jul 06 15:35:14 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:14 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-c9bcd9da-0f0d-4b49-b9f3-fbd8846537e1 tempest-VolumesSnapshotTestJSON-488916833 None] Create snapshot completed successfully Jul 06 15:35:15 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-948e4d55-1733-4f81-8f7e-da48124da41b 1073741824" returned: 0 in 0.850s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-948e4d55-1733-4f81-8f7e-da48124da41b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:15 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-948e4d55-1733-4f81-8f7e-da48124da41b Jul 06 15:35:15 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:15 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b7e61da3-533a-4289-8bdd-3ce49e6ceb1e tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "cinder-b773f70a-421a-49dc-b505-f98302cf26e1-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:15 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b7e61da3-533a-4289-8bdd-3ce49e6ceb1e tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-b773f70a-421a-49dc-b505-f98302cf26e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:15 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b7e61da3-533a-4289-8bdd-3ce49e6ceb1e tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "cinder-quobyte-b015a3b8-21ab-4bbc-85fb-1e515a5dff69" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:15 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b7e61da3-533a-4289-8bdd-3ce49e6ceb1e tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-b015a3b8-21ab-4bbc-85fb-1e515a5dff69" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:15 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b7e61da3-533a-4289-8bdd-3ce49e6ceb1e tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "cinder-quobyte-b773f70a-421a-49dc-b505-f98302cf26e1" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:15 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b7e61da3-533a-4289-8bdd-3ce49e6ceb1e tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-b773f70a-421a-49dc-b505-f98302cf26e1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:15 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-b7e61da3-533a-4289-8bdd-3ce49e6ceb1e tempest-VolumesSnapshotTestJSON-488916833 None] Deleting offline snapshot b773f70a-421a-49dc-b505-f98302cf26e1 of volume b015a3b8-21ab-4bbc-85fb-1e515a5dff69 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:35:15 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-b7e61da3-533a-4289-8bdd-3ce49e6ceb1e tempest-VolumesSnapshotTestJSON-488916833 None] snapshot_file for this snap is: volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69.b773f70a-421a-49dc-b505-f98302cf26e1 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:35:15 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[a243150a-cf0f-4378-b3df-436b5525c959]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b7e61da3-533a-4289-8bdd-3ce49e6ceb1e tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69.b773f70a-421a-49dc-b505-f98302cf26e1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:16 devstack sudo[96395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69.b773f70a-421a-49dc-b505-f98302cf26e1 Jul 06 15:35:16 devstack sudo[96395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:16 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-948e4d55-1733-4f81-8f7e-da48124da41b" returned: 0 in 0.652s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:16 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:35:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-bbeb8a57-58d3-4469-8913-2934d3c85910 req-7ba263d8-f9d3-4f9d-bb98-f4edf1b14a59 tempest-AttachVolumeNegativeTest-823541462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.779s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66874387-b76b-4036-b60a-baec97806698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-948e4d55-1733-4f81-8f7e-da48124da41b', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c38405ba-4f76-4c65-a6cd-72160beb39be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:16 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4706fb-5d58-467c-bdb6-94f0563a3504]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-bbeb8a57-58d3-4469-8913-2934d3c85910 req-7ba263d8-f9d3-4f9d-bb98-f4edf1b14a59 tempest-AttachVolumeNegativeTest-823541462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d899e854-b24b-4aa4-9cba-6a52b7ce6d10 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:16 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Volume volume-948e4d55-1733-4f81-8f7e-da48124da41b (948e4d55-1733-4f81-8f7e-da48124da41b): created successfully Jul 06 15:35:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c38405ba-4f76-4c65-a6cd-72160beb39be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Flow 'volume_create_manager' (14c7b481-f6cd-407f-9002-164db788d459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:16 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-f2ad8eec-b13d-4090-8bbe-1c9059605de0 tempest-VolumesTransfersTest-1108323971 None] Created volume successfully. Jul 06 15:35:16 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d899e854-b24b-4aa4-9cba-6a52b7ce6d10 Jul 06 15:35:16 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:16 devstack sudo[96395]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b7e61da3-533a-4289-8bdd-3ce49e6ceb1e tempest-VolumesSnapshotTestJSON-488916833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69.b773f70a-421a-49dc-b505-f98302cf26e1" returned: 0 in 0.986s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:16 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-b7e61da3-533a-4289-8bdd-3ce49e6ceb1e tempest-VolumesSnapshotTestJSON-488916833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:35:17 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6b6976-d433-4518-9a9f-4a4509357459]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b7e61da3-533a-4289-8bdd-3ce49e6ceb1e tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:17 devstack sudo[96433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69 Jul 06 15:35:17 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-bbeb8a57-58d3-4469-8913-2934d3c85910 req-7ba263d8-f9d3-4f9d-bb98-f4edf1b14a59 tempest-AttachVolumeNegativeTest-823541462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d899e854-b24b-4aa4-9cba-6a52b7ce6d10" returned: 0 in 1.083s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-bbeb8a57-58d3-4469-8913-2934d3c85910 req-7ba263d8-f9d3-4f9d-bb98-f4edf1b14a59 tempest-AttachVolumeNegativeTest-823541462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.119s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:17 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:17 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-bbeb8a57-58d3-4469-8913-2934d3c85910 req-7ba263d8-f9d3-4f9d-bb98-f4edf1b14a59 tempest-AttachVolumeNegativeTest-823541462 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce', 'name': 'volume-d899e854-b24b-4aa4-9cba-6a52b7ce6d10', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f041081-d615-4c62-b3a6-846125cae5f1', 'enforce_multipath': True} {{(pid=86148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:35:17 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-bbeb8a57-58d3-4469-8913-2934d3c85910 req-7ba263d8-f9d3-4f9d-bb98-f4edf1b14a59 tempest-AttachVolumeNegativeTest-823541462 None] attachment_update completed successfully. Jul 06 15:35:17 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-ff6f481f-6dbe-40c2-8d85-57d1d7b5c92f tempest-VolumesTransfersTest-158590539 None] Transfer volume completed successfully. Jul 06 15:35:18 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b7e61da3-533a-4289-8bdd-3ce49e6ceb1e tempest-VolumesSnapshotTestJSON-488916833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69" returned: 0 in 1.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b7e61da3-533a-4289-8bdd-3ce49e6ceb1e tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69.b773f70a-421a-49dc-b505-f98302cf26e1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:18 devstack sudo[96458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69.b773f70a-421a-49dc-b505-f98302cf26e1 Jul 06 15:35:18 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:19 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b7e61da3-533a-4289-8bdd-3ce49e6ceb1e tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69.b773f70a-421a-49dc-b505-f98302cf26e1" returned: 0 in 0.966s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b7e61da3-533a-4289-8bdd-3ce49e6ceb1e tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69.b773f70a-421a-49dc-b505-f98302cf26e1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:19 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69.b773f70a-421a-49dc-b505-f98302cf26e1 Jul 06 15:35:19 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a541ff71-6b76-4009-a1be-354d600d90f5 tempest-VolumesTransfersTest-244823433 None] Acquiring lock "cinder-948e4d55-1733-4f81-8f7e-da48124da41b-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a541ff71-6b76-4009-a1be-354d600d90f5 tempest-VolumesTransfersTest-244823433 None] Lock "cinder-948e4d55-1733-4f81-8f7e-da48124da41b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a541ff71-6b76-4009-a1be-354d600d90f5 tempest-VolumesTransfersTest-244823433 None] Acquiring lock "cinder-quobyte-948e4d55-1733-4f81-8f7e-da48124da41b" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a541ff71-6b76-4009-a1be-354d600d90f5 tempest-VolumesTransfersTest-244823433 None] Lock "cinder-quobyte-948e4d55-1733-4f81-8f7e-da48124da41b" acquired by "delete_volume" :: waited 0.028s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:19 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbfbb98-eb2a-4fd3-8c28-e24ba9ade8f8]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a541ff71-6b76-4009-a1be-354d600d90f5 tempest-VolumesTransfersTest-244823433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-948e4d55-1733-4f81-8f7e-da48124da41b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:19 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-948e4d55-1733-4f81-8f7e-da48124da41b Jul 06 15:35:19 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:19 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b7e61da3-533a-4289-8bdd-3ce49e6ceb1e tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69.b773f70a-421a-49dc-b505-f98302cf26e1" returned: 0 in 0.765s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b7e61da3-533a-4289-8bdd-3ce49e6ceb1e tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-b773f70a-421a-49dc-b505-f98302cf26e1" released by "_delete_snapshot" :: held 3.904s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b7e61da3-533a-4289-8bdd-3ce49e6ceb1e tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-b015a3b8-21ab-4bbc-85fb-1e515a5dff69" released by "delete_snapshot" :: held 3.931s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:19 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-b7e61da3-533a-4289-8bdd-3ce49e6ceb1e tempest-VolumesSnapshotTestJSON-488916833 None] Created reservations ['b38c3992-b179-462a-91cd-2415aacfd8cf', '7167e051-85b9-422b-96b7-b7dfd70aac1c', 'a2ff3487-1696-4f22-93c2-72ad5078d8cc', 'd78c5146-1828-4540-84f6-adae4ad6b933'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:35:19 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-b7e61da3-533a-4289-8bdd-3ce49e6ceb1e tempest-VolumesSnapshotTestJSON-488916833 None] Delete snapshot completed successfully. Jul 06 15:35:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b7e61da3-533a-4289-8bdd-3ce49e6ceb1e tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-b773f70a-421a-49dc-b505-f98302cf26e1-delete_snapshot" released by "delete_snapshot" :: held 4.153s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:20 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a541ff71-6b76-4009-a1be-354d600d90f5 tempest-VolumesTransfersTest-244823433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-948e4d55-1733-4f81-8f7e-da48124da41b" returned: 0 in 0.965s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a541ff71-6b76-4009-a1be-354d600d90f5 tempest-VolumesTransfersTest-244823433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-948e4d55-1733-4f81-8f7e-da48124da41b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:20 devstack sudo[96876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-948e4d55-1733-4f81-8f7e-da48124da41b Jul 06 15:35:20 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:20 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:35:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Flow 'volume_create_manager' (14372eb0-6dee-4259-b93b-f7d8dce48ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3534508-8183-4ef3-8666-6e3fdb306032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3534508-8183-4ef3-8666-6e3fdb306032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1575557624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dd1e953-9f98-4ca1-b776-d14b1064fd87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b2df85079b34aacbc4881185ed9f331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:21Z,use_quota=True,user_id='474277430b324c4c95f5f6c06a88054f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fefded3-6f49-4896-98b2-4dab99612154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fefded3-6f49-4896-98b2-4dab99612154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba1f8382-b35d-4bed-8ac9-46b5b8c35444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba1f8382-b35d-4bed-8ac9-46b5b8c35444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dd1e953-9f98-4ca1-b776-d14b1064fd87', 'volume_name': 'volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fee32bab-2d3e-4a47-85c5-3d4866166398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fee32bab-2d3e-4a47-85c5-3d4866166398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5b1111-fed4-4f93-8119-490e7738cbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:20 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Volume 3dd1e953-9f98-4ca1-b776-d14b1064fd87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87', 'volume_size': 1} Jul 06 15:35:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1575557624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dd1e953-9f98-4ca1-b776-d14b1064fd87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b2df85079b34aacbc4881185ed9f331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:21Z,use_quota=True,user_id='474277430b324c4c95f5f6c06a88054f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:35:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Creating volume 3dd1e953-9f98-4ca1-b776-d14b1064fd87 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:35:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:35:20 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:35:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:21 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87 1073741824 Jul 06 15:35:21 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:21 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a541ff71-6b76-4009-a1be-354d600d90f5 tempest-VolumesTransfersTest-244823433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-948e4d55-1733-4f81-8f7e-da48124da41b" returned: 0 in 0.888s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:21 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a541ff71-6b76-4009-a1be-354d600d90f5 tempest-VolumesTransfersTest-244823433 None] Lock "cinder-quobyte-948e4d55-1733-4f81-8f7e-da48124da41b" released by "delete_volume" :: held 1.905s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:21 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-a541ff71-6b76-4009-a1be-354d600d90f5 tempest-VolumesTransfersTest-244823433 None] Created reservations ['1e3bb2ad-29b0-48df-aeba-81c383a4a9e9', '4e52f43d-2238-43e3-a4b7-59b1749b043b', '56dba8d6-5f61-415a-a316-eb1a498cee92', '1d9adcb3-0d59-4089-84a0-e60cc75bbdec'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:35:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a541ff71-6b76-4009-a1be-354d600d90f5 tempest-VolumesTransfersTest-244823433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a541ff71-6b76-4009-a1be-354d600d90f5 tempest-VolumesTransfersTest-244823433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a541ff71-6b76-4009-a1be-354d600d90f5 tempest-VolumesTransfersTest-244823433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a541ff71-6b76-4009-a1be-354d600d90f5 tempest-VolumesTransfersTest-244823433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a541ff71-6b76-4009-a1be-354d600d90f5 tempest-VolumesTransfersTest-244823433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a541ff71-6b76-4009-a1be-354d600d90f5 tempest-VolumesTransfersTest-244823433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:21 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:35:21 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:22 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87 1073741824" returned: 0 in 1.232s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:22 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87 Jul 06 15:35:22 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:22 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a541ff71-6b76-4009-a1be-354d600d90f5 tempest-VolumesTransfersTest-244823433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.310s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:22 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-a541ff71-6b76-4009-a1be-354d600d90f5 tempest-VolumesTransfersTest-244823433 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:35:22 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a541ff71-6b76-4009-a1be-354d600d90f5 tempest-VolumesTransfersTest-244823433 None] Deleted volume successfully. Jul 06 15:35:22 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a541ff71-6b76-4009-a1be-354d600d90f5 tempest-VolumesTransfersTest-244823433 None] Lock "cinder-948e4d55-1733-4f81-8f7e-da48124da41b-delete_volume" released by "delete_volume" :: held 3.497s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:22 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:35:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Flow 'volume_create_manager' (79a96608-0039-4a35-8cba-6fd57d6ee785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a3622f-e23a-4b8c-bcd5-64a1c456d53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a3622f-e23a-4b8c-bcd5-64a1c456d53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1434015978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d64df23-6069-4295-9b68-ad04b0f399bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7760d3201776451bb1acbcc22eb9b4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:23Z,use_quota=True,user_id='88e0b97e7a604fb1857f0cf0e0bf9438',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00cd7545-8c87-49f1-b946-e44ed2d529b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00cd7545-8c87-49f1-b946-e44ed2d529b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13410ba-af64-4df1-b25e-9a7c2d3d57e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13410ba-af64-4df1-b25e-9a7c2d3d57e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d64df23-6069-4295-9b68-ad04b0f399bf', 'volume_name': 'volume-4d64df23-6069-4295-9b68-ad04b0f399bf', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2f2ee3-f408-4f32-9730-0c865fb13281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2f2ee3-f408-4f32-9730-0c865fb13281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00b76f7-4309-4678-90d2-ea76bbf9726c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:22 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Volume 4d64df23-6069-4295-9b68-ad04b0f399bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d64df23-6069-4295-9b68-ad04b0f399bf', 'volume_size': 1} Jul 06 15:35:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:23 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87" returned: 0 in 0.886s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] <== create_volume: return (2223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:35:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.227s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.294s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1434015978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d64df23-6069-4295-9b68-ad04b0f399bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7760d3201776451bb1acbcc22eb9b4c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:23Z,use_quota=True,user_id='88e0b97e7a604fb1857f0cf0e0bf9438',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:35:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Creating volume 4d64df23-6069-4295-9b68-ad04b0f399bf {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:35:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:35:23 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:35:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4d64df23-6069-4295-9b68-ad04b0f399bf 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5b1111-fed4-4f93-8119-490e7738cbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:23 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4d64df23-6069-4295-9b68-ad04b0f399bf 1073741824 Jul 06 15:35:23 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e7a5e6-1677-4cb3-8e15-d7a05c4a3c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:23 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Volume volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87 (3dd1e953-9f98-4ca1-b776-d14b1064fd87): created successfully Jul 06 15:35:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e7a5e6-1677-4cb3-8e15-d7a05c4a3c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Flow 'volume_create_manager' (14372eb0-6dee-4259-b93b-f7d8dce48ac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:23 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-00a112c0-b80f-419e-b4ae-a851d94a4f07 tempest-VolumesSnapshotTestJSON-488916833 None] Created volume successfully. Jul 06 15:35:24 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4d64df23-6069-4295-9b68-ad04b0f399bf 1073741824" returned: 0 in 0.942s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4d64df23-6069-4295-9b68-ad04b0f399bf {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:24 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4d64df23-6069-4295-9b68-ad04b0f399bf Jul 06 15:35:24 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:24 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-cb6765ac-9dfb-4639-8546-6105e98693af req-445f46a5-c5d2-4c73-826e-2bdde29cbfb9 tempest-AttachVolumeNegativeTest-823541462 None] Terminate volume connection completed successfully. Jul 06 15:35:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-cb6765ac-9dfb-4639-8546-6105e98693af req-445f46a5-c5d2-4c73-826e-2bdde29cbfb9 tempest-AttachVolumeNegativeTest-823541462 None] Deleting attachment 0f041081-d615-4c62-b3a6-846125cae5f1. {{(pid=86148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:35:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2c17b4f5-702a-428e-b26c-6aeafd438810 tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:25 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4d64df23-6069-4295-9b68-ad04b0f399bf" returned: 0 in 0.857s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:25 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] <== create_volume: return (1860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:35:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2c17b4f5-702a-428e-b26c-6aeafd438810 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.488s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:25 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-2c17b4f5-702a-428e-b26c-6aeafd438810 tempest-VolumesSnapshotTestJSON-488916833 None] Creating offline snapshot 805f2e60-757a-4d71-bacb-c671c45559cf of volume 3dd1e953-9f98-4ca1-b776-d14b1064fd87 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:35:25 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00b76f7-4309-4678-90d2-ea76bbf9726c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d64df23-6069-4295-9b68-ad04b0f399bf', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:25 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a5ec774-4c48-41b6-871e-e42ebe50d735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:25 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadf1469-5ced-4d66-8353-b0d2720fd383]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2c17b4f5-702a-428e-b26c-6aeafd438810 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:25 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Volume volume-4d64df23-6069-4295-9b68-ad04b0f399bf (4d64df23-6069-4295-9b68-ad04b0f399bf): created successfully Jul 06 15:35:25 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a5ec774-4c48-41b6-871e-e42ebe50d735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:25 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Flow 'volume_create_manager' (79a96608-0039-4a35-8cba-6fd57d6ee785) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:25 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-2ae98260-c75e-4d4a-92d5-24252f970ee8 tempest-VolumesTransfersTest-1108323971 None] Created volume successfully. Jul 06 15:35:25 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87 Jul 06 15:35:25 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:26 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2c17b4f5-702a-428e-b26c-6aeafd438810 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87" returned: 0 in 1.084s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2c17b4f5-702a-428e-b26c-6aeafd438810 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.805f2e60-757a-4d71-bacb-c671c45559cf 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5d506ed6-a1a7-463c-a0a6-e7803a3cb205 tempest-VolumesTransfersTest-244823433 None] Acquiring lock "cinder-4d64df23-6069-4295-9b68-ad04b0f399bf-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:26 devstack sudo[96933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.805f2e60-757a-4d71-bacb-c671c45559cf 1G Jul 06 15:35:26 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5d506ed6-a1a7-463c-a0a6-e7803a3cb205 tempest-VolumesTransfersTest-244823433 None] Lock "cinder-4d64df23-6069-4295-9b68-ad04b0f399bf-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5d506ed6-a1a7-463c-a0a6-e7803a3cb205 tempest-VolumesTransfersTest-244823433 None] Acquiring lock "cinder-quobyte-4d64df23-6069-4295-9b68-ad04b0f399bf" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5d506ed6-a1a7-463c-a0a6-e7803a3cb205 tempest-VolumesTransfersTest-244823433 None] Lock "cinder-quobyte-4d64df23-6069-4295-9b68-ad04b0f399bf" acquired by "delete_volume" :: waited 0.015s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:26 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df8d658-bff8-4727-bd06-e8060a7fdb58]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5d506ed6-a1a7-463c-a0a6-e7803a3cb205 tempest-VolumesTransfersTest-244823433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4d64df23-6069-4295-9b68-ad04b0f399bf {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:26 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4d64df23-6069-4295-9b68-ad04b0f399bf Jul 06 15:35:26 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:27 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2c17b4f5-702a-428e-b26c-6aeafd438810 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.805f2e60-757a-4d71-bacb-c671c45559cf 1G" returned: 0 in 1.152s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2c17b4f5-702a-428e-b26c-6aeafd438810 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.805f2e60-757a-4d71-bacb-c671c45559cf {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:27 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5d506ed6-a1a7-463c-a0a6-e7803a3cb205 tempest-VolumesTransfersTest-244823433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4d64df23-6069-4295-9b68-ad04b0f399bf" returned: 0 in 0.989s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5d506ed6-a1a7-463c-a0a6-e7803a3cb205 tempest-VolumesTransfersTest-244823433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4d64df23-6069-4295-9b68-ad04b0f399bf {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:27 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.805f2e60-757a-4d71-bacb-c671c45559cf Jul 06 15:35:27 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:27 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4d64df23-6069-4295-9b68-ad04b0f399bf Jul 06 15:35:27 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:28 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:28 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2c17b4f5-702a-428e-b26c-6aeafd438810 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.805f2e60-757a-4d71-bacb-c671c45559cf" returned: 0 in 0.720s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:28 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-2c17b4f5-702a-428e-b26c-6aeafd438810 tempest-VolumesSnapshotTestJSON-488916833 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.805f2e60-757a-4d71-bacb-c671c45559cf is being set with open permissions: ugo+rw Jul 06 15:35:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2c17b4f5-702a-428e-b26c-6aeafd438810 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.805f2e60-757a-4d71-bacb-c671c45559cf {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5d506ed6-a1a7-463c-a0a6-e7803a3cb205 tempest-VolumesTransfersTest-244823433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4d64df23-6069-4295-9b68-ad04b0f399bf" returned: 0 in 0.717s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:28 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.805f2e60-757a-4d71-bacb-c671c45559cf Jul 06 15:35:28 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:28 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5d506ed6-a1a7-463c-a0a6-e7803a3cb205 tempest-VolumesTransfersTest-244823433 None] Lock "cinder-quobyte-4d64df23-6069-4295-9b68-ad04b0f399bf" released by "delete_volume" :: held 1.763s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:28 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-5d506ed6-a1a7-463c-a0a6-e7803a3cb205 tempest-VolumesTransfersTest-244823433 None] Created reservations ['14f2e8d2-31ee-4c0c-bb1a-cfb4e29964cb', 'c19c9154-3274-45e9-9399-a652afafd248', '0bed1405-aa52-4497-a4cd-3198f8ee87c6', '14c78320-8725-4747-8229-a8dbbbfee72b'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:35:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5d506ed6-a1a7-463c-a0a6-e7803a3cb205 tempest-VolumesTransfersTest-244823433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5d506ed6-a1a7-463c-a0a6-e7803a3cb205 tempest-VolumesTransfersTest-244823433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:28 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5d506ed6-a1a7-463c-a0a6-e7803a3cb205 tempest-VolumesTransfersTest-244823433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:28 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5d506ed6-a1a7-463c-a0a6-e7803a3cb205 tempest-VolumesTransfersTest-244823433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5d506ed6-a1a7-463c-a0a6-e7803a3cb205 tempest-VolumesTransfersTest-244823433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5d506ed6-a1a7-463c-a0a6-e7803a3cb205 tempest-VolumesTransfersTest-244823433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:28 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:35:28 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:29 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2c17b4f5-702a-428e-b26c-6aeafd438810 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.805f2e60-757a-4d71-bacb-c671c45559cf" returned: 0 in 1.311s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2c17b4f5-702a-428e-b26c-6aeafd438810 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:29 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.info Jul 06 15:35:29 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:29 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5d506ed6-a1a7-463c-a0a6-e7803a3cb205 tempest-VolumesTransfersTest-244823433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.356s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:29 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-5d506ed6-a1a7-463c-a0a6-e7803a3cb205 tempest-VolumesTransfersTest-244823433 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:35:29 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-5d506ed6-a1a7-463c-a0a6-e7803a3cb205 tempest-VolumesTransfersTest-244823433 None] Deleted volume successfully. Jul 06 15:35:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5d506ed6-a1a7-463c-a0a6-e7803a3cb205 tempest-VolumesTransfersTest-244823433 None] Lock "cinder-4d64df23-6069-4295-9b68-ad04b0f399bf-delete_volume" released by "delete_volume" :: held 3.463s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:30 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2c17b4f5-702a-428e-b26c-6aeafd438810 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.info" returned: 0 in 1.147s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:30 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-2c17b4f5-702a-428e-b26c-6aeafd438810 tempest-VolumesSnapshotTestJSON-488916833 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.info is being set with open permissions: ugo+rw Jul 06 15:35:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2c17b4f5-702a-428e-b26c-6aeafd438810 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:30 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.info Jul 06 15:35:30 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:31 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2c17b4f5-702a-428e-b26c-6aeafd438810 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.info" returned: 0 in 1.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2c17b4f5-702a-428e-b26c-6aeafd438810 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.603s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:31 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=63,cinder:INSERT=20,cinder:UPDATE=66,cinder:DELETE=7 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:35:31 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=72,cinder:UPDATE=65,cinder:INSERT=22,cinder:DELETE=5 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:35:31 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-2c17b4f5-702a-428e-b26c-6aeafd438810 tempest-VolumesSnapshotTestJSON-488916833 None] Create snapshot completed successfully Jul 06 15:35:32 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:35:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Flow 'volume_create_manager' (8dc0b688-6852-4f1f-adb4-0efac9c9ad1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14223e81-b9d8-4ce1-9037-025ecbfddbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14223e81-b9d8-4ce1-9037-025ecbfddbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-636326372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c251153-1311-4d97-a2a1-2ddf5b7a8e7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b2df85079b34aacbc4881185ed9f331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=805f2e60-757a-4d71-bacb-c671c45559cf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:33Z,use_quota=True,user_id='474277430b324c4c95f5f6c06a88054f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afdae5bc-fc2b-437d-9628-7fab9a2ad0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afdae5bc-fc2b-437d-9628-7fab9a2ad0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db14bee-ae4c-46f6-bf8a-1437f4a11301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db14bee-ae4c-46f6-bf8a-1437f4a11301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8c251153-1311-4d97-a2a1-2ddf5b7a8e7f', 'volume_name': 'volume-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f', 'volume_size': 2, 'snapshot_id': '805f2e60-757a-4d71-bacb-c671c45559cf'}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5069ed65-c6b1-4aad-972e-157b2708d486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5069ed65-c6b1-4aad-972e-157b2708d486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4734fb73-0513-49a4-9312-5876839ff31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:32 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Volume 8c251153-1311-4d97-a2a1-2ddf5b7a8e7f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f', 'volume_size': 2, 'snapshot_id': '805f2e60-757a-4d71-bacb-c671c45559cf'} Jul 06 15:35:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "cinder-quobyte-805f2e60-757a-4d71-bacb-c671c45559cf-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f" by "_create_volume_from_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-805f2e60-757a-4d71-bacb-c671c45559cf-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:32 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Creating volume 8c251153-1311-4d97-a2a1-2ddf5b7a8e7f from snapshot 805f2e60-757a-4d71-bacb-c671c45559cf {{(pid=86148) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 15:35:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:35:33 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "cinder-quobyte-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f" by "_copy_volume_from_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:33 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] snapshot: 805f2e60-757a-4d71-bacb-c671c45559cf, volume: 8c251153-1311-4d97-a2a1-2ddf5b7a8e7f, {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 15:35:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:33 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b10df2-dd50-4e01-adc9-d64e088fd5d7]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.805f2e60-757a-4d71-bacb-c671c45559cf {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:33 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.805f2e60-757a-4d71-bacb-c671c45559cf Jul 06 15:35:33 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:33 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.805f2e60-757a-4d71-bacb-c671c45559cf" returned: 0 in 0.803s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:35:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87 {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 15:35:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Creating direct copy from snapshot {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 15:35:33 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b891757-e159-4363-8973-8297d735c5fb]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:34 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87 Jul 06 15:35:34 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:34 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87" returned: 0 in 0.811s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:34 devstack cinder-volume[86148]: DEBUG cinder.utils [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Path /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f not found in is_blk_device check {{(pid=86148) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 15:35:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:34 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f Jul 06 15:35:34 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8d27f624-5804-434e-b032-31d748a2a9fd tempest-AttachVolumeNegativeTest-823541462 None] Acquiring lock "cinder-d899e854-b24b-4aa4-9cba-6a52b7ce6d10-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8d27f624-5804-434e-b032-31d748a2a9fd tempest-AttachVolumeNegativeTest-823541462 None] Lock "cinder-d899e854-b24b-4aa4-9cba-6a52b7ce6d10-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8d27f624-5804-434e-b032-31d748a2a9fd tempest-AttachVolumeNegativeTest-823541462 None] Acquiring lock "cinder-quobyte-d899e854-b24b-4aa4-9cba-6a52b7ce6d10" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8d27f624-5804-434e-b032-31d748a2a9fd tempest-AttachVolumeNegativeTest-823541462 None] Lock "cinder-quobyte-d899e854-b24b-4aa4-9cba-6a52b7ce6d10" acquired by "delete_volume" :: waited 0.022s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:36 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a4c718-ddc2-42f2-ae5d-db3f79ac9784]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8d27f624-5804-434e-b032-31d748a2a9fd tempest-AttachVolumeNegativeTest-823541462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d899e854-b24b-4aa4-9cba-6a52b7ce6d10 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:36 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d899e854-b24b-4aa4-9cba-6a52b7ce6d10 Jul 06 15:35:36 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:38 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8d27f624-5804-434e-b032-31d748a2a9fd tempest-AttachVolumeNegativeTest-823541462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d899e854-b24b-4aa4-9cba-6a52b7ce6d10" returned: 0 in 1.661s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8d27f624-5804-434e-b032-31d748a2a9fd tempest-AttachVolumeNegativeTest-823541462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d899e854-b24b-4aa4-9cba-6a52b7ce6d10 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:38 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d899e854-b24b-4aa4-9cba-6a52b7ce6d10 Jul 06 15:35:38 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:35:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:38 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:35:38 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:40 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8d27f624-5804-434e-b032-31d748a2a9fd tempest-AttachVolumeNegativeTest-823541462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d899e854-b24b-4aa4-9cba-6a52b7ce6d10" returned: 0 in 2.206s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:40 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8d27f624-5804-434e-b032-31d748a2a9fd tempest-AttachVolumeNegativeTest-823541462 None] Lock "cinder-quobyte-d899e854-b24b-4aa4-9cba-6a52b7ce6d10" released by "delete_volume" :: held 3.976s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:40 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-8d27f624-5804-434e-b032-31d748a2a9fd tempest-AttachVolumeNegativeTest-823541462 None] Created reservations ['14b5d910-235e-43a9-8b70-27adaae36fc3', '1c4fa407-8075-48e5-8963-34cd3af4a745', 'bec89f2f-4f07-453c-9c38-17e658e4cdd5', '58de17ac-93d7-4406-8e89-9be6a496660c'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:35:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8d27f624-5804-434e-b032-31d748a2a9fd tempest-AttachVolumeNegativeTest-823541462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8d27f624-5804-434e-b032-31d748a2a9fd tempest-AttachVolumeNegativeTest-823541462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-8d27f624-5804-434e-b032-31d748a2a9fd tempest-AttachVolumeNegativeTest-823541462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-8d27f624-5804-434e-b032-31d748a2a9fd tempest-AttachVolumeNegativeTest-823541462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8d27f624-5804-434e-b032-31d748a2a9fd tempest-AttachVolumeNegativeTest-823541462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8d27f624-5804-434e-b032-31d748a2a9fd tempest-AttachVolumeNegativeTest-823541462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:40 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 2.426s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:40 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:35:40 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager._thread_info {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:35:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread count: 28 {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:35:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread info: [<_MainThread(MainThread, started 124857273856128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:35:40 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:35:40 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:40 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f" returned: 0 in 6.290s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:41 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[4849ab59-f940-4ec4-81ef-ed450819d955]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:41 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87 Jul 06 15:35:41 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-22225bd7-45a6-4b39-bf37-b5055932fbed tempest-AttachVolumeNegativeTest-823541462 None] Acquiring lock "cinder-6ebf58fc-b295-4a17-803b-ada403c83c56-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-22225bd7-45a6-4b39-bf37-b5055932fbed tempest-AttachVolumeNegativeTest-823541462 None] Lock "cinder-6ebf58fc-b295-4a17-803b-ada403c83c56-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-22225bd7-45a6-4b39-bf37-b5055932fbed tempest-AttachVolumeNegativeTest-823541462 None] Acquiring lock "cinder-quobyte-6ebf58fc-b295-4a17-803b-ada403c83c56" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-22225bd7-45a6-4b39-bf37-b5055932fbed tempest-AttachVolumeNegativeTest-823541462 None] Lock "cinder-quobyte-6ebf58fc-b295-4a17-803b-ada403c83c56" acquired by "delete_volume" :: waited 0.041s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:41 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2eeb50-6c58-4de5-a51a-8cd75cdc0902]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-22225bd7-45a6-4b39-bf37-b5055932fbed tempest-AttachVolumeNegativeTest-823541462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6ebf58fc-b295-4a17-803b-ada403c83c56 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:41 devstack sudo[97085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6ebf58fc-b295-4a17-803b-ada403c83c56 Jul 06 15:35:41 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:41 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8d27f624-5804-434e-b032-31d748a2a9fd tempest-AttachVolumeNegativeTest-823541462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.878s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:41 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-8d27f624-5804-434e-b032-31d748a2a9fd tempest-AttachVolumeNegativeTest-823541462 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:35:41 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-8d27f624-5804-434e-b032-31d748a2a9fd tempest-AttachVolumeNegativeTest-823541462 None] Deleted volume successfully. Jul 06 15:35:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8d27f624-5804-434e-b032-31d748a2a9fd tempest-AttachVolumeNegativeTest-823541462 None] Lock "cinder-d899e854-b24b-4aa4-9cba-6a52b7ce6d10-delete_volume" released by "delete_volume" :: held 5.455s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:41 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:35:41 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Flow 'volume_create_manager' (50077263-5ea6-449d-911c-3f851019b512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:41 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7678d7e5-d990-4df2-881a-f1a0803d8987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:41 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7678d7e5-d990-4df2-881a-f1a0803d8987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-685246863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a668f4-b3e5-46d3-9e8a-314f1f5ed965,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d6724ebcf8a477a9a8aec3e3db488f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:42Z,use_quota=True,user_id='ffcc08430e7f4af89ef97d93e16521b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:41 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd1e695f-ff80-4298-a013-8349f8c55fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:41 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd1e695f-ff80-4298-a013-8349f8c55fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:41 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5cd8fbc-46d3-4c1a-ad17-a5b1ca38aa92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:41 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5cd8fbc-46d3-4c1a-ad17-a5b1ca38aa92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65a668f4-b3e5-46d3-9e8a-314f1f5ed965', 'volume_name': 'volume-65a668f4-b3e5-46d3-9e8a-314f1f5ed965', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:41 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf842ad1-01dd-4f71-b5e2-6b1cd106be86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:41 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf842ad1-01dd-4f71-b5e2-6b1cd106be86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:41 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7d6f1f2-f19c-4054-9b70-12cea8d8ffb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:41 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Volume 65a668f4-b3e5-46d3-9e8a-314f1f5ed965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65a668f4-b3e5-46d3-9e8a-314f1f5ed965', 'volume_size': 1} Jul 06 15:35:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:42 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87" returned: 0 in 1.274s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:42 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87, size 1024.00 MB, duration 6.29 sec, destination /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f {{(pid=86148) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:35:42 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Converted 1024.00 MB image at 162.76 MB/s Jul 06 15:35:42 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f is being set with open permissions: ugo+rw Jul 06 15:35:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:42 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f Jul 06 15:35:42 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:42 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-22225bd7-45a6-4b39-bf37-b5055932fbed tempest-AttachVolumeNegativeTest-823541462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6ebf58fc-b295-4a17-803b-ada403c83c56" returned: 0 in 0.871s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-22225bd7-45a6-4b39-bf37-b5055932fbed tempest-AttachVolumeNegativeTest-823541462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6ebf58fc-b295-4a17-803b-ada403c83c56 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:42 devstack sudo[97095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6ebf58fc-b295-4a17-803b-ada403c83c56 Jul 06 15:35:42 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:42 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f" returned: 0 in 0.657s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:42 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f" released by "_copy_volume_from_snapshot" :: held 9.938s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:42 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-805f2e60-757a-4d71-bacb-c671c45559cf-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f" released by "_create_volume_from_snapshot" :: held 9.976s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.998s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.022s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:42 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-685246863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a668f4-b3e5-46d3-9e8a-314f1f5ed965,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d6724ebcf8a477a9a8aec3e3db488f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:42Z,use_quota=True,user_id='ffcc08430e7f4af89ef97d93e16521b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:35:42 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Creating volume 65a668f4-b3e5-46d3-9e8a-314f1f5ed965 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:35:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:42 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:42 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:42 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:35:42 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:35:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-65a668f4-b3e5-46d3-9e8a-314f1f5ed965 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:43 devstack sudo[97099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-65a668f4-b3e5-46d3-9e8a-314f1f5ed965 1073741824 Jul 06 15:35:43 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4734fb73-0513-49a4-9312-5876839ff31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f', 'volume_size': 2, 'snapshot_id': '805f2e60-757a-4d71-bacb-c671c45559cf'}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe72e4cb-b18a-4f53-a5b4-a7e5c6a950f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:43 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Volume volume-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f (8c251153-1311-4d97-a2a1-2ddf5b7a8e7f): created successfully Jul 06 15:35:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe72e4cb-b18a-4f53-a5b4-a7e5c6a950f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Flow 'volume_create_manager' (8dc0b688-6852-4f1f-adb4-0efac9c9ad1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:43 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-eb097ec8-2591-4cc0-a71d-8865aa3e908c tempest-VolumesSnapshotTestJSON-488916833 None] Created volume successfully. Jul 06 15:35:43 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-22225bd7-45a6-4b39-bf37-b5055932fbed tempest-AttachVolumeNegativeTest-823541462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6ebf58fc-b295-4a17-803b-ada403c83c56" returned: 0 in 0.689s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-22225bd7-45a6-4b39-bf37-b5055932fbed tempest-AttachVolumeNegativeTest-823541462 None] Lock "cinder-quobyte-6ebf58fc-b295-4a17-803b-ada403c83c56" released by "delete_volume" :: held 1.640s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:43 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-22225bd7-45a6-4b39-bf37-b5055932fbed tempest-AttachVolumeNegativeTest-823541462 None] Created reservations ['4e8a647c-1462-4d3b-9f0b-7e27e85eac41', '472f8d44-458d-469e-a6ff-87e8535bfe3a', 'eb325acd-d380-4702-8f1d-e76650fa3417', 'd37eb5b9-c5d6-4ae0-9c8d-d1ce8b5d89a1'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:35:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-22225bd7-45a6-4b39-bf37-b5055932fbed tempest-AttachVolumeNegativeTest-823541462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-22225bd7-45a6-4b39-bf37-b5055932fbed tempest-AttachVolumeNegativeTest-823541462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:43 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-22225bd7-45a6-4b39-bf37-b5055932fbed tempest-AttachVolumeNegativeTest-823541462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:43 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-22225bd7-45a6-4b39-bf37-b5055932fbed tempest-AttachVolumeNegativeTest-823541462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-22225bd7-45a6-4b39-bf37-b5055932fbed tempest-AttachVolumeNegativeTest-823541462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-22225bd7-45a6-4b39-bf37-b5055932fbed tempest-AttachVolumeNegativeTest-823541462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:43 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:35:43 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e2550784-4490-4616-bb7a-5c509c59cb52 tempest-AttachVolumeNegativeTest-823541462 None] Acquiring lock "cinder-39a10864-ada5-4dd8-a439-7bb9e7d945f6-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e2550784-4490-4616-bb7a-5c509c59cb52 tempest-AttachVolumeNegativeTest-823541462 None] Lock "cinder-39a10864-ada5-4dd8-a439-7bb9e7d945f6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e2550784-4490-4616-bb7a-5c509c59cb52 tempest-AttachVolumeNegativeTest-823541462 None] Acquiring lock "cinder-quobyte-39a10864-ada5-4dd8-a439-7bb9e7d945f6" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e2550784-4490-4616-bb7a-5c509c59cb52 tempest-AttachVolumeNegativeTest-823541462 None] Lock "cinder-quobyte-39a10864-ada5-4dd8-a439-7bb9e7d945f6" acquired by "delete_volume" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:43 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d5907d-5ef2-4cad-9272-8588a781f288]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e2550784-4490-4616-bb7a-5c509c59cb52 tempest-AttachVolumeNegativeTest-823541462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-39a10864-ada5-4dd8-a439-7bb9e7d945f6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:43 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:43 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-65a668f4-b3e5-46d3-9e8a-314f1f5ed965 1073741824" returned: 0 in 0.918s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-22225bd7-45a6-4b39-bf37-b5055932fbed tempest-AttachVolumeNegativeTest-823541462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.694s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:43 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-22225bd7-45a6-4b39-bf37-b5055932fbed tempest-AttachVolumeNegativeTest-823541462 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:35:43 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-22225bd7-45a6-4b39-bf37-b5055932fbed tempest-AttachVolumeNegativeTest-823541462 None] Deleted volume successfully. Jul 06 15:35:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-22225bd7-45a6-4b39-bf37-b5055932fbed tempest-AttachVolumeNegativeTest-823541462 None] Lock "cinder-6ebf58fc-b295-4a17-803b-ada403c83c56-delete_volume" released by "delete_volume" :: held 2.612s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-65a668f4-b3e5-46d3-9e8a-314f1f5ed965 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:43 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-65a668f4-b3e5-46d3-9e8a-314f1f5ed965 Jul 06 15:35:43 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:44 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-39a10864-ada5-4dd8-a439-7bb9e7d945f6 Jul 06 15:35:44 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-21c8eefe-3c32-4e71-a2b1-4c5038ca0118 tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "cinder-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-21c8eefe-3c32-4e71-a2b1-4c5038ca0118 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-21c8eefe-3c32-4e71-a2b1-4c5038ca0118 tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "cinder-quobyte-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-21c8eefe-3c32-4e71-a2b1-4c5038ca0118 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f" acquired by "delete_volume" :: waited 0.014s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:44 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b638b0b-f5c6-4983-9507-068150c0f9ac]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-21c8eefe-3c32-4e71-a2b1-4c5038ca0118 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:44 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f Jul 06 15:35:44 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:44 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-65a668f4-b3e5-46d3-9e8a-314f1f5ed965" returned: 0 in 0.687s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:35:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:44 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e2550784-4490-4616-bb7a-5c509c59cb52 tempest-AttachVolumeNegativeTest-823541462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-39a10864-ada5-4dd8-a439-7bb9e7d945f6" returned: 0 in 0.781s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e2550784-4490-4616-bb7a-5c509c59cb52 tempest-AttachVolumeNegativeTest-823541462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-39a10864-ada5-4dd8-a439-7bb9e7d945f6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7d6f1f2-f19c-4054-9b70-12cea8d8ffb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65a668f4-b3e5-46d3-9e8a-314f1f5ed965', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:44 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-39a10864-ada5-4dd8-a439-7bb9e7d945f6 Jul 06 15:35:44 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a73d268-ef4b-4685-8b88-470f8d5cfeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:44 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Volume volume-65a668f4-b3e5-46d3-9e8a-314f1f5ed965 (65a668f4-b3e5-46d3-9e8a-314f1f5ed965): created successfully Jul 06 15:35:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a73d268-ef4b-4685-8b88-470f8d5cfeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Flow 'volume_create_manager' (50077263-5ea6-449d-911c-3f851019b512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:44 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-d343f80e-8748-43b1-ab97-0f2c5e2fd2cf tempest-VolumesListTestJSON-797449069 None] Created volume successfully. Jul 06 15:35:45 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-21c8eefe-3c32-4e71-a2b1-4c5038ca0118 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f" returned: 0 in 0.795s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-21c8eefe-3c32-4e71-a2b1-4c5038ca0118 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:45 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f Jul 06 15:35:45 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:45 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e2550784-4490-4616-bb7a-5c509c59cb52 tempest-AttachVolumeNegativeTest-823541462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-39a10864-ada5-4dd8-a439-7bb9e7d945f6" returned: 0 in 0.718s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e2550784-4490-4616-bb7a-5c509c59cb52 tempest-AttachVolumeNegativeTest-823541462 None] Lock "cinder-quobyte-39a10864-ada5-4dd8-a439-7bb9e7d945f6" released by "delete_volume" :: held 1.543s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-e2550784-4490-4616-bb7a-5c509c59cb52 tempest-AttachVolumeNegativeTest-823541462 None] Created reservations ['494df806-8a4b-4cf1-b359-e0bb0faaaee8', '5ba9451c-372a-404c-8acc-54292c75f508', '801145bf-21f6-4ff2-9bdb-683e6d3ec2ca', 'f3e1d6da-3e1d-4fc0-a8cf-a6ab53500727'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Flow 'volume_create_manager' (c8b86d1c-cb67-46a4-9250-3b4a8df88acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73c8644f-3d30-4023-b655-6c194a472bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73c8644f-3d30-4023-b655-6c194a472bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1367681945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f281a29-24be-455d-b149-febc5e71be2a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d6724ebcf8a477a9a8aec3e3db488f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:45Z,use_quota=True,user_id='ffcc08430e7f4af89ef97d93e16521b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6251cfeb-8bb6-403a-a38e-691c1409fd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6251cfeb-8bb6-403a-a38e-691c1409fd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d20b100-f625-48d1-8b2f-e00b63cfd659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d20b100-f625-48d1-8b2f-e00b63cfd659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f281a29-24be-455d-b149-febc5e71be2a', 'volume_name': 'volume-2f281a29-24be-455d-b149-febc5e71be2a', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1acb24a4-dd89-4c1b-b410-6f73f23f00d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1acb24a4-dd89-4c1b-b410-6f73f23f00d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9144abd-a77c-4f32-805d-9d2c59ffb560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:45 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Volume 2f281a29-24be-455d-b149-febc5e71be2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f281a29-24be-455d-b149-febc5e71be2a', 'volume_size': 1} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1367681945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f281a29-24be-455d-b149-febc5e71be2a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d6724ebcf8a477a9a8aec3e3db488f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:45Z,use_quota=True,user_id='ffcc08430e7f4af89ef97d93e16521b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Creating volume 2f281a29-24be-455d-b149-febc5e71be2a {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:35:45 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2f281a29-24be-455d-b149-febc5e71be2a 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:45 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2f281a29-24be-455d-b149-febc5e71be2a 1073741824 Jul 06 15:35:45 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e2550784-4490-4616-bb7a-5c509c59cb52 tempest-AttachVolumeNegativeTest-823541462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e2550784-4490-4616-bb7a-5c509c59cb52 tempest-AttachVolumeNegativeTest-823541462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e2550784-4490-4616-bb7a-5c509c59cb52 tempest-AttachVolumeNegativeTest-823541462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e2550784-4490-4616-bb7a-5c509c59cb52 tempest-AttachVolumeNegativeTest-823541462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e2550784-4490-4616-bb7a-5c509c59cb52 tempest-AttachVolumeNegativeTest-823541462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e2550784-4490-4616-bb7a-5c509c59cb52 tempest-AttachVolumeNegativeTest-823541462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:45 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:35:45 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:45 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-21c8eefe-3c32-4e71-a2b1-4c5038ca0118 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f" returned: 0 in 0.730s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-21c8eefe-3c32-4e71-a2b1-4c5038ca0118 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f" released by "delete_volume" :: held 1.575s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-21c8eefe-3c32-4e71-a2b1-4c5038ca0118 tempest-VolumesSnapshotTestJSON-488916833 None] Created reservations ['a1148aa5-b192-4c59-9e17-412f3026f157', '45ec8185-ffb1-4910-a30a-5ff9f4200327', '06af48ec-8745-4219-aa69-8a08ea971410', 'd2338c6c-ff2f-440d-8623-cb6bf9e9cb8a'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-21c8eefe-3c32-4e71-a2b1-4c5038ca0118 tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-21c8eefe-3c32-4e71-a2b1-4c5038ca0118 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-21c8eefe-3c32-4e71-a2b1-4c5038ca0118 tempest-VolumesSnapshotTestJSON-488916833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-21c8eefe-3c32-4e71-a2b1-4c5038ca0118 tempest-VolumesSnapshotTestJSON-488916833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-21c8eefe-3c32-4e71-a2b1-4c5038ca0118 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-21c8eefe-3c32-4e71-a2b1-4c5038ca0118 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:45 devstack sudo[97132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:35:45 devstack sudo[97132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:46 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e2550784-4490-4616-bb7a-5c509c59cb52 tempest-AttachVolumeNegativeTest-823541462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.777s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:46 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-e2550784-4490-4616-bb7a-5c509c59cb52 tempest-AttachVolumeNegativeTest-823541462 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:35:46 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-e2550784-4490-4616-bb7a-5c509c59cb52 tempest-AttachVolumeNegativeTest-823541462 None] Deleted volume successfully. Jul 06 15:35:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e2550784-4490-4616-bb7a-5c509c59cb52 tempest-AttachVolumeNegativeTest-823541462 None] Lock "cinder-39a10864-ada5-4dd8-a439-7bb9e7d945f6-delete_volume" released by "delete_volume" :: held 2.681s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f7b5cb8d-cd17-40a0-8b8b-42a4d103a685 tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "cinder-805f2e60-757a-4d71-bacb-c671c45559cf-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f7b5cb8d-cd17-40a0-8b8b-42a4d103a685 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-805f2e60-757a-4d71-bacb-c671c45559cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f7b5cb8d-cd17-40a0-8b8b-42a4d103a685 tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "cinder-quobyte-3dd1e953-9f98-4ca1-b776-d14b1064fd87" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f7b5cb8d-cd17-40a0-8b8b-42a4d103a685 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-3dd1e953-9f98-4ca1-b776-d14b1064fd87" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f7b5cb8d-cd17-40a0-8b8b-42a4d103a685 tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "cinder-quobyte-805f2e60-757a-4d71-bacb-c671c45559cf" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f7b5cb8d-cd17-40a0-8b8b-42a4d103a685 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-805f2e60-757a-4d71-bacb-c671c45559cf" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-f7b5cb8d-cd17-40a0-8b8b-42a4d103a685 tempest-VolumesSnapshotTestJSON-488916833 None] Deleting offline snapshot 805f2e60-757a-4d71-bacb-c671c45559cf of volume 3dd1e953-9f98-4ca1-b776-d14b1064fd87 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:35:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-f7b5cb8d-cd17-40a0-8b8b-42a4d103a685 tempest-VolumesSnapshotTestJSON-488916833 None] snapshot_file for this snap is: volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.805f2e60-757a-4d71-bacb-c671c45559cf {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:35:46 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d9ec6f-29e1-4c54-9f8c-5fc12ede6a7f]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f7b5cb8d-cd17-40a0-8b8b-42a4d103a685 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.805f2e60-757a-4d71-bacb-c671c45559cf {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:46 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2f281a29-24be-455d-b149-febc5e71be2a 1073741824" returned: 0 in 1.149s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2f281a29-24be-455d-b149-febc5e71be2a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:46 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2f281a29-24be-455d-b149-febc5e71be2a Jul 06 15:35:46 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:46 devstack sudo[97132]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:46 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.805f2e60-757a-4d71-bacb-c671c45559cf Jul 06 15:35:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-21c8eefe-3c32-4e71-a2b1-4c5038ca0118 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.885s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:46 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:46 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-21c8eefe-3c32-4e71-a2b1-4c5038ca0118 tempest-VolumesSnapshotTestJSON-488916833 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:35:46 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-21c8eefe-3c32-4e71-a2b1-4c5038ca0118 tempest-VolumesSnapshotTestJSON-488916833 None] Deleted volume successfully. Jul 06 15:35:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-21c8eefe-3c32-4e71-a2b1-4c5038ca0118 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-8c251153-1311-4d97-a2a1-2ddf5b7a8e7f-delete_volume" released by "delete_volume" :: held 2.756s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:47 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2f281a29-24be-455d-b149-febc5e71be2a" returned: 0 in 0.703s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:47 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] <== create_volume: return (1896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:35:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.899s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:47 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9144abd-a77c-4f32-805d-9d2c59ffb560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f281a29-24be-455d-b149-febc5e71be2a', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:47 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd1d1e1-8fde-4fc3-aef0-6dc2b0951995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:47 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Volume volume-2f281a29-24be-455d-b149-febc5e71be2a (2f281a29-24be-455d-b149-febc5e71be2a): created successfully Jul 06 15:35:47 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd1d1e1-8fde-4fc3-aef0-6dc2b0951995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:47 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Flow 'volume_create_manager' (c8b86d1c-cb67-46a4-9250-3b4a8df88acf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:47 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-58d64b7d-db45-4b96-9245-54917374f0af tempest-VolumesListTestJSON-797449069 None] Created volume successfully. Jul 06 15:35:47 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f7b5cb8d-cd17-40a0-8b8b-42a4d103a685 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.805f2e60-757a-4d71-bacb-c671c45559cf" returned: 0 in 0.869s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:47 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-f7b5cb8d-cd17-40a0-8b8b-42a4d103a685 tempest-VolumesSnapshotTestJSON-488916833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:35:47 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e72f793-6e63-443e-a6d5-af5893b4aacc]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f7b5cb8d-cd17-40a0-8b8b-42a4d103a685 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:47 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87 Jul 06 15:35:47 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:48 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f7b5cb8d-cd17-40a0-8b8b-42a4d103a685 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87" returned: 0 in 0.754s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f7b5cb8d-cd17-40a0-8b8b-42a4d103a685 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.805f2e60-757a-4d71-bacb-c671c45559cf {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:48 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.805f2e60-757a-4d71-bacb-c671c45559cf Jul 06 15:35:48 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:49 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f7b5cb8d-cd17-40a0-8b8b-42a4d103a685 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.805f2e60-757a-4d71-bacb-c671c45559cf" returned: 0 in 0.999s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f7b5cb8d-cd17-40a0-8b8b-42a4d103a685 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.805f2e60-757a-4d71-bacb-c671c45559cf {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:49 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:35:49 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.805f2e60-757a-4d71-bacb-c671c45559cf Jul 06 15:35:49 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Flow 'volume_create_manager' (542898cc-d00c-4f4b-9685-966de3fdb070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8693159d-3287-471d-bfb9-cad898a940af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8693159d-3287-471d-bfb9-cad898a940af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-442688167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4d129e-095e-4c79-9ba8-14da2ce8ac8c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d6724ebcf8a477a9a8aec3e3db488f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:49Z,use_quota=True,user_id='ffcc08430e7f4af89ef97d93e16521b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a92255d-edfe-4533-8d93-54f3e885a311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a92255d-edfe-4533-8d93-54f3e885a311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae77634-bbd2-406a-a88c-bd9b20fa093a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae77634-bbd2-406a-a88c-bd9b20fa093a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da4d129e-095e-4c79-9ba8-14da2ce8ac8c', 'volume_name': 'volume-da4d129e-095e-4c79-9ba8-14da2ce8ac8c', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c118390-1016-4682-b7eb-5aec732916e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c118390-1016-4682-b7eb-5aec732916e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (057374ee-7ae6-4643-9f27-888e73f6f1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:49 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Volume da4d129e-095e-4c79-9ba8-14da2ce8ac8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da4d129e-095e-4c79-9ba8-14da2ce8ac8c', 'volume_size': 1} Jul 06 15:35:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-442688167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4d129e-095e-4c79-9ba8-14da2ce8ac8c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d6724ebcf8a477a9a8aec3e3db488f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:49Z,use_quota=True,user_id='ffcc08430e7f4af89ef97d93e16521b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:35:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Creating volume da4d129e-095e-4c79-9ba8-14da2ce8ac8c {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:35:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:35:49 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:35:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da4d129e-095e-4c79-9ba8-14da2ce8ac8c 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:49 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da4d129e-095e-4c79-9ba8-14da2ce8ac8c 1073741824 Jul 06 15:35:49 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-db1a2e61-aae8-49e5-b2cd-6e38430d9031 req-fe9ccf33-7172-4cd9-b955-74ad10821e42 tempest-TestStampPattern-150571277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:50 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f7b5cb8d-cd17-40a0-8b8b-42a4d103a685 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87.805f2e60-757a-4d71-bacb-c671c45559cf" returned: 0 in 0.861s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:50 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f7b5cb8d-cd17-40a0-8b8b-42a4d103a685 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-805f2e60-757a-4d71-bacb-c671c45559cf" released by "_delete_snapshot" :: held 3.611s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:50 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f7b5cb8d-cd17-40a0-8b8b-42a4d103a685 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-3dd1e953-9f98-4ca1-b776-d14b1064fd87" released by "delete_snapshot" :: held 3.649s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:50 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-f7b5cb8d-cd17-40a0-8b8b-42a4d103a685 tempest-VolumesSnapshotTestJSON-488916833 None] Created reservations ['50907773-6d34-4803-aa82-f6676ed3611e', '9f9aede5-53ea-4416-a920-40213e69e60d', '5d4984f1-88b8-49e7-a3fe-740238495ef9', '47e39e42-728a-4026-ad56-009ede95b4aa'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:35:50 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-f7b5cb8d-cd17-40a0-8b8b-42a4d103a685 tempest-VolumesSnapshotTestJSON-488916833 None] Delete snapshot completed successfully. Jul 06 15:35:50 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f7b5cb8d-cd17-40a0-8b8b-42a4d103a685 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-805f2e60-757a-4d71-bacb-c671c45559cf-delete_snapshot" released by "delete_snapshot" :: held 3.806s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:50 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da4d129e-095e-4c79-9ba8-14da2ce8ac8c 1073741824" returned: 0 in 1.079s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da4d129e-095e-4c79-9ba8-14da2ce8ac8c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:50 devstack sudo[97184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da4d129e-095e-4c79-9ba8-14da2ce8ac8c Jul 06 15:35:50 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:50 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dc3024c1-9321-4ece-b6e9-4162a160416c tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "cinder-3dd1e953-9f98-4ca1-b776-d14b1064fd87-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:50 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dc3024c1-9321-4ece-b6e9-4162a160416c tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-3dd1e953-9f98-4ca1-b776-d14b1064fd87-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:51 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dc3024c1-9321-4ece-b6e9-4162a160416c tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "cinder-quobyte-3dd1e953-9f98-4ca1-b776-d14b1064fd87" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:51 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dc3024c1-9321-4ece-b6e9-4162a160416c tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-3dd1e953-9f98-4ca1-b776-d14b1064fd87" acquired by "delete_volume" :: waited 0.014s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:51 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[8550c8bc-eb82-4e24-89ea-a008e2a89886]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dc3024c1-9321-4ece-b6e9-4162a160416c tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:51 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87 Jul 06 15:35:51 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:51 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da4d129e-095e-4c79-9ba8-14da2ce8ac8c" returned: 0 in 0.771s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] <== create_volume: return (1911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:35:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.916s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-db1a2e61-aae8-49e5-b2cd-6e38430d9031 req-fe9ccf33-7172-4cd9-b955-74ad10821e42 tempest-TestStampPattern-150571277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.613s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (057374ee-7ae6-4643-9f27-888e73f6f1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da4d129e-095e-4c79-9ba8-14da2ce8ac8c', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca6425b-cd58-4853-bf93-2aa2c2a8523a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:51 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2106bf8-195f-4163-80dc-041bbb3f110d]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-db1a2e61-aae8-49e5-b2cd-6e38430d9031 req-fe9ccf33-7172-4cd9-b955-74ad10821e42 tempest-TestStampPattern-150571277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:51 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Volume volume-da4d129e-095e-4c79-9ba8-14da2ce8ac8c (da4d129e-095e-4c79-9ba8-14da2ce8ac8c): created successfully Jul 06 15:35:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca6425b-cd58-4853-bf93-2aa2c2a8523a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Flow 'volume_create_manager' (542898cc-d00c-4f4b-9685-966de3fdb070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:51 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-5309ff4b-bb3a-4203-aea2-c222318525a6 tempest-VolumesListTestJSON-797449069 None] Created volume successfully. Jul 06 15:35:51 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b Jul 06 15:35:51 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:52 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dc3024c1-9321-4ece-b6e9-4162a160416c tempest-VolumesSnapshotTestJSON-488916833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87" returned: 0 in 0.987s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dc3024c1-9321-4ece-b6e9-4162a160416c tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:52 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87 Jul 06 15:35:52 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:52 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-db1a2e61-aae8-49e5-b2cd-6e38430d9031 req-fe9ccf33-7172-4cd9-b955-74ad10821e42 tempest-TestStampPattern-150571277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b" returned: 0 in 0.918s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-db1a2e61-aae8-49e5-b2cd-6e38430d9031 req-fe9ccf33-7172-4cd9-b955-74ad10821e42 tempest-TestStampPattern-150571277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.960s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-db1a2e61-aae8-49e5-b2cd-6e38430d9031 req-fe9ccf33-7172-4cd9-b955-74ad10821e42 tempest-TestStampPattern-150571277 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce', 'name': 'volume-5c568390-9d78-48fe-845c-2f90ff72701b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8cfca0f3-5b6d-4351-97cd-b1cabd8bc35e', 'enforce_multipath': True} {{(pid=86148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:35:52 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-db1a2e61-aae8-49e5-b2cd-6e38430d9031 req-fe9ccf33-7172-4cd9-b955-74ad10821e42 tempest-TestStampPattern-150571277 None] attachment_update completed successfully. Jul 06 15:35:52 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dc3024c1-9321-4ece-b6e9-4162a160416c tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3dd1e953-9f98-4ca1-b776-d14b1064fd87" returned: 0 in 0.776s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:52 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dc3024c1-9321-4ece-b6e9-4162a160416c tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-3dd1e953-9f98-4ca1-b776-d14b1064fd87" released by "delete_volume" :: held 1.844s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:52 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-dc3024c1-9321-4ece-b6e9-4162a160416c tempest-VolumesSnapshotTestJSON-488916833 None] Created reservations ['0fb784b3-a3ae-4825-86f6-916ad9d0017b', '7b3c4225-7acb-4670-bf26-5473d9523406', 'c853c84f-98ea-43b3-b74f-179daf74e148', '062ead94-86a8-42ec-8721-f984df53f531'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:35:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-dc3024c1-9321-4ece-b6e9-4162a160416c tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-dc3024c1-9321-4ece-b6e9-4162a160416c tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:53 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-dc3024c1-9321-4ece-b6e9-4162a160416c tempest-VolumesSnapshotTestJSON-488916833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:53 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-dc3024c1-9321-4ece-b6e9-4162a160416c tempest-VolumesSnapshotTestJSON-488916833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-dc3024c1-9321-4ece-b6e9-4162a160416c tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dc3024c1-9321-4ece-b6e9-4162a160416c tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:53 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:35:53 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:53 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dc3024c1-9321-4ece-b6e9-4162a160416c tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.837s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:53 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-dc3024c1-9321-4ece-b6e9-4162a160416c tempest-VolumesSnapshotTestJSON-488916833 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:35:53 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-dc3024c1-9321-4ece-b6e9-4162a160416c tempest-VolumesSnapshotTestJSON-488916833 None] Deleted volume successfully. Jul 06 15:35:53 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dc3024c1-9321-4ece-b6e9-4162a160416c tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-3dd1e953-9f98-4ca1-b776-d14b1064fd87-delete_volume" released by "delete_volume" :: held 2.944s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:54 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:35:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Flow 'volume_create_manager' (1767068f-f6b3-4b81-83ab-cafb67b81895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71daae70-6829-46c1-a1ab-56629fa21b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71daae70-6829-46c1-a1ab-56629fa21b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-526247065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1137081c-f0b6-4a08-99e1-14e8dd73c59f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b2df85079b34aacbc4881185ed9f331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:54Z,use_quota=True,user_id='474277430b324c4c95f5f6c06a88054f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d64e7d-d801-47da-b8d4-b12436a31f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d64e7d-d801-47da-b8d4-b12436a31f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d103799a-9565-4e4b-a26d-079d07abc053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d103799a-9565-4e4b-a26d-079d07abc053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1137081c-f0b6-4a08-99e1-14e8dd73c59f', 'volume_name': 'volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7815ff1-ba2a-489d-b811-da2be5616a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7815ff1-ba2a-489d-b811-da2be5616a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df14242b-6ea5-4114-847f-c643beb792df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:54 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Volume 1137081c-f0b6-4a08-99e1-14e8dd73c59f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f', 'volume_size': 1} Jul 06 15:35:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-526247065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1137081c-f0b6-4a08-99e1-14e8dd73c59f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b2df85079b34aacbc4881185ed9f331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:54Z,use_quota=True,user_id='474277430b324c4c95f5f6c06a88054f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:35:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Creating volume 1137081c-f0b6-4a08-99e1-14e8dd73c59f {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:35:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:35:54 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:35:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:54 devstack sudo[97600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f 1073741824 Jul 06 15:35:54 devstack sudo[97600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:55 devstack sudo[97600]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f 1073741824" returned: 0 in 0.868s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:55 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f Jul 06 15:35:55 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1e1c7022-95cd-4a15-8b5e-1a30fe6e5718 tempest-VolumesListTestJSON-797449069 None] Acquiring lock "cinder-da4d129e-095e-4c79-9ba8-14da2ce8ac8c-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1e1c7022-95cd-4a15-8b5e-1a30fe6e5718 tempest-VolumesListTestJSON-797449069 None] Lock "cinder-da4d129e-095e-4c79-9ba8-14da2ce8ac8c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1e1c7022-95cd-4a15-8b5e-1a30fe6e5718 tempest-VolumesListTestJSON-797449069 None] Acquiring lock "cinder-quobyte-da4d129e-095e-4c79-9ba8-14da2ce8ac8c" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1e1c7022-95cd-4a15-8b5e-1a30fe6e5718 tempest-VolumesListTestJSON-797449069 None] Lock "cinder-quobyte-da4d129e-095e-4c79-9ba8-14da2ce8ac8c" acquired by "delete_volume" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:55 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd345bd5-c9df-4aa3-93d3-bf25fb3e6993]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1e1c7022-95cd-4a15-8b5e-1a30fe6e5718 tempest-VolumesListTestJSON-797449069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da4d129e-095e-4c79-9ba8-14da2ce8ac8c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:55 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da4d129e-095e-4c79-9ba8-14da2ce8ac8c Jul 06 15:35:55 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:55 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7e489d88-b84d-4c64-a2cb-41da24020bc5 tempest-BackendsCapabilitiesAdminTestsJSON-266862849 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86148) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 06 15:35:55 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f" returned: 0 in 0.651s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:55 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:35:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:55 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df14242b-6ea5-4114-847f-c643beb792df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:55 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a740f36-646f-449f-b411-206da8c68d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:55 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Volume volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f (1137081c-f0b6-4a08-99e1-14e8dd73c59f): created successfully Jul 06 15:35:55 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a740f36-646f-449f-b411-206da8c68d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:55 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Flow 'volume_create_manager' (1767068f-f6b3-4b81-83ab-cafb67b81895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:55 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-4a371386-8177-4396-b90c-fb6771ef9160 tempest-VolumesSnapshotTestJSON-488916833 None] Created volume successfully. Jul 06 15:35:55 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-36248264-f3b2-49a7-a710-bbd1770ac161 tempest-BackendsCapabilitiesAdminTestsJSON-266862849 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86148) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 06 15:35:56 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1e1c7022-95cd-4a15-8b5e-1a30fe6e5718 tempest-VolumesListTestJSON-797449069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da4d129e-095e-4c79-9ba8-14da2ce8ac8c" returned: 0 in 0.783s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1e1c7022-95cd-4a15-8b5e-1a30fe6e5718 tempest-VolumesListTestJSON-797449069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da4d129e-095e-4c79-9ba8-14da2ce8ac8c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:56 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da4d129e-095e-4c79-9ba8-14da2ce8ac8c Jul 06 15:35:56 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f5b5446b-9d73-4560-b917-226f5a1d9459 tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f5b5446b-9d73-4560-b917-226f5a1d9459 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-f5b5446b-9d73-4560-b917-226f5a1d9459 tempest-VolumesSnapshotTestJSON-488916833 None] Creating offline snapshot f6082f13-1ff1-4f20-80ef-9a6385f2e305 of volume 1137081c-f0b6-4a08-99e1-14e8dd73c59f {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:35:56 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03e3ce0-f2f7-4f4e-8689-bc3d838d0fa0]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f5b5446b-9d73-4560-b917-226f5a1d9459 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:56 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f Jul 06 15:35:56 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:56 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1e1c7022-95cd-4a15-8b5e-1a30fe6e5718 tempest-VolumesListTestJSON-797449069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da4d129e-095e-4c79-9ba8-14da2ce8ac8c" returned: 0 in 0.734s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1e1c7022-95cd-4a15-8b5e-1a30fe6e5718 tempest-VolumesListTestJSON-797449069 None] Lock "cinder-quobyte-da4d129e-095e-4c79-9ba8-14da2ce8ac8c" released by "delete_volume" :: held 1.561s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:56 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-1e1c7022-95cd-4a15-8b5e-1a30fe6e5718 tempest-VolumesListTestJSON-797449069 None] Created reservations ['116c29aa-6203-40f0-900f-5e38852109c8', '2ca6a398-f720-43ae-81b3-c6e6a25d5e2a', '34e1cd6e-43de-47a6-8977-8dc66ce80c1c', 'a51f446d-0cba-4164-9a5b-5cb7ad4b4746'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:35:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1e1c7022-95cd-4a15-8b5e-1a30fe6e5718 tempest-VolumesListTestJSON-797449069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1e1c7022-95cd-4a15-8b5e-1a30fe6e5718 tempest-VolumesListTestJSON-797449069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1e1c7022-95cd-4a15-8b5e-1a30fe6e5718 tempest-VolumesListTestJSON-797449069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1e1c7022-95cd-4a15-8b5e-1a30fe6e5718 tempest-VolumesListTestJSON-797449069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1e1c7022-95cd-4a15-8b5e-1a30fe6e5718 tempest-VolumesListTestJSON-797449069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1e1c7022-95cd-4a15-8b5e-1a30fe6e5718 tempest-VolumesListTestJSON-797449069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:57 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:35:57 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:57 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f5b5446b-9d73-4560-b917-226f5a1d9459 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f" returned: 0 in 0.832s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f5b5446b-9d73-4560-b917-226f5a1d9459 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.f6082f13-1ff1-4f20-80ef-9a6385f2e305 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:57 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.f6082f13-1ff1-4f20-80ef-9a6385f2e305 1G Jul 06 15:35:57 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:57 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-04e9a296-977e-4c05-94d0-5c13a351aae2 tempest-VolumesListTestJSON-797449069 None] Acquiring lock "cinder-2f281a29-24be-455d-b149-febc5e71be2a-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:57 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-04e9a296-977e-4c05-94d0-5c13a351aae2 tempest-VolumesListTestJSON-797449069 None] Lock "cinder-2f281a29-24be-455d-b149-febc5e71be2a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:57 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-04e9a296-977e-4c05-94d0-5c13a351aae2 tempest-VolumesListTestJSON-797449069 None] Acquiring lock "cinder-quobyte-2f281a29-24be-455d-b149-febc5e71be2a" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:57 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-04e9a296-977e-4c05-94d0-5c13a351aae2 tempest-VolumesListTestJSON-797449069 None] Lock "cinder-quobyte-2f281a29-24be-455d-b149-febc5e71be2a" acquired by "delete_volume" :: waited 0.025s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:57 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c06be0-e703-424d-8c67-4194dac4cae3]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-04e9a296-977e-4c05-94d0-5c13a351aae2 tempest-VolumesListTestJSON-797449069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2f281a29-24be-455d-b149-febc5e71be2a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:57 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1e1c7022-95cd-4a15-8b5e-1a30fe6e5718 tempest-VolumesListTestJSON-797449069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.843s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:57 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-1e1c7022-95cd-4a15-8b5e-1a30fe6e5718 tempest-VolumesListTestJSON-797449069 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:35:57 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-1e1c7022-95cd-4a15-8b5e-1a30fe6e5718 tempest-VolumesListTestJSON-797449069 None] Deleted volume successfully. Jul 06 15:35:57 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2f281a29-24be-455d-b149-febc5e71be2a Jul 06 15:35:57 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:57 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1e1c7022-95cd-4a15-8b5e-1a30fe6e5718 tempest-VolumesListTestJSON-797449069 None] Lock "cinder-da4d129e-095e-4c79-9ba8-14da2ce8ac8c-delete_volume" released by "delete_volume" :: held 2.632s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:58 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f5b5446b-9d73-4560-b917-226f5a1d9459 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.f6082f13-1ff1-4f20-80ef-9a6385f2e305 1G" returned: 0 in 1.099s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f5b5446b-9d73-4560-b917-226f5a1d9459 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.f6082f13-1ff1-4f20-80ef-9a6385f2e305 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:58 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.f6082f13-1ff1-4f20-80ef-9a6385f2e305 Jul 06 15:35:58 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:58 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-04e9a296-977e-4c05-94d0-5c13a351aae2 tempest-VolumesListTestJSON-797449069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2f281a29-24be-455d-b149-febc5e71be2a" returned: 0 in 0.956s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-04e9a296-977e-4c05-94d0-5c13a351aae2 tempest-VolumesListTestJSON-797449069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2f281a29-24be-455d-b149-febc5e71be2a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:58 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2f281a29-24be-455d-b149-febc5e71be2a Jul 06 15:35:58 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:59 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f5b5446b-9d73-4560-b917-226f5a1d9459 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.f6082f13-1ff1-4f20-80ef-9a6385f2e305" returned: 0 in 0.889s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:59 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-f5b5446b-9d73-4560-b917-226f5a1d9459 tempest-VolumesSnapshotTestJSON-488916833 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.f6082f13-1ff1-4f20-80ef-9a6385f2e305 is being set with open permissions: ugo+rw Jul 06 15:35:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f5b5446b-9d73-4560-b917-226f5a1d9459 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.f6082f13-1ff1-4f20-80ef-9a6385f2e305 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:59 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.f6082f13-1ff1-4f20-80ef-9a6385f2e305 Jul 06 15:35:59 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:59 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-04e9a296-977e-4c05-94d0-5c13a351aae2 tempest-VolumesListTestJSON-797449069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2f281a29-24be-455d-b149-febc5e71be2a" returned: 0 in 0.845s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-04e9a296-977e-4c05-94d0-5c13a351aae2 tempest-VolumesListTestJSON-797449069 None] Lock "cinder-quobyte-2f281a29-24be-455d-b149-febc5e71be2a" released by "delete_volume" :: held 1.894s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:59 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-04e9a296-977e-4c05-94d0-5c13a351aae2 tempest-VolumesListTestJSON-797449069 None] Created reservations ['9bc48501-43a3-40c5-a70e-2fd454211e74', '06c559a4-e750-4d2c-b5bf-3a4304db0a0a', '7349930d-b49f-4ab8-b321-7056ac57d21c', 'bab721c5-d189-498a-a374-34ec63e8877e'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:35:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-04e9a296-977e-4c05-94d0-5c13a351aae2 tempest-VolumesListTestJSON-797449069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-04e9a296-977e-4c05-94d0-5c13a351aae2 tempest-VolumesListTestJSON-797449069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:59 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-04e9a296-977e-4c05-94d0-5c13a351aae2 tempest-VolumesListTestJSON-797449069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:59 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-04e9a296-977e-4c05-94d0-5c13a351aae2 tempest-VolumesListTestJSON-797449069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-04e9a296-977e-4c05-94d0-5c13a351aae2 tempest-VolumesListTestJSON-797449069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-04e9a296-977e-4c05-94d0-5c13a351aae2 tempest-VolumesListTestJSON-797449069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:59 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:35:59 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:59 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f5b5446b-9d73-4560-b917-226f5a1d9459 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.f6082f13-1ff1-4f20-80ef-9a6385f2e305" returned: 0 in 0.804s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f5b5446b-9d73-4560-b917-226f5a1d9459 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-19718200-3b83-4c16-a221-fb5436e77765 tempest-VolumesListTestJSON-797449069 None] Acquiring lock "cinder-65a668f4-b3e5-46d3-9e8a-314f1f5ed965-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:59 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.info Jul 06 15:35:59 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:00 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-19718200-3b83-4c16-a221-fb5436e77765 tempest-VolumesListTestJSON-797449069 None] Lock "cinder-65a668f4-b3e5-46d3-9e8a-314f1f5ed965-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:00 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-19718200-3b83-4c16-a221-fb5436e77765 tempest-VolumesListTestJSON-797449069 None] Acquiring lock "cinder-quobyte-65a668f4-b3e5-46d3-9e8a-314f1f5ed965" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:00 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-19718200-3b83-4c16-a221-fb5436e77765 tempest-VolumesListTestJSON-797449069 None] Lock "cinder-quobyte-65a668f4-b3e5-46d3-9e8a-314f1f5ed965" acquired by "delete_volume" :: waited 0.029s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:00 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[825a11a9-5062-4ce9-a199-b90fcabb5622]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-19718200-3b83-4c16-a221-fb5436e77765 tempest-VolumesListTestJSON-797449069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-65a668f4-b3e5-46d3-9e8a-314f1f5ed965 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:00 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-65a668f4-b3e5-46d3-9e8a-314f1f5ed965 Jul 06 15:36:00 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:00 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-04e9a296-977e-4c05-94d0-5c13a351aae2 tempest-VolumesListTestJSON-797449069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.957s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:00 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-04e9a296-977e-4c05-94d0-5c13a351aae2 tempest-VolumesListTestJSON-797449069 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:36:00 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-04e9a296-977e-4c05-94d0-5c13a351aae2 tempest-VolumesListTestJSON-797449069 None] Deleted volume successfully. Jul 06 15:36:00 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-04e9a296-977e-4c05-94d0-5c13a351aae2 tempest-VolumesListTestJSON-797449069 None] Lock "cinder-2f281a29-24be-455d-b149-febc5e71be2a-delete_volume" released by "delete_volume" :: held 3.127s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:00 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f5b5446b-9d73-4560-b917-226f5a1d9459 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.info" returned: 0 in 0.881s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:00 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-f5b5446b-9d73-4560-b917-226f5a1d9459 tempest-VolumesSnapshotTestJSON-488916833 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.info is being set with open permissions: ugo+rw Jul 06 15:36:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f5b5446b-9d73-4560-b917-226f5a1d9459 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:00 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.info Jul 06 15:36:00 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:01 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-19718200-3b83-4c16-a221-fb5436e77765 tempest-VolumesListTestJSON-797449069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-65a668f4-b3e5-46d3-9e8a-314f1f5ed965" returned: 0 in 1.138s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-19718200-3b83-4c16-a221-fb5436e77765 tempest-VolumesListTestJSON-797449069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-65a668f4-b3e5-46d3-9e8a-314f1f5ed965 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:01 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-65a668f4-b3e5-46d3-9e8a-314f1f5ed965 Jul 06 15:36:01 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:01 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f5b5446b-9d73-4560-b917-226f5a1d9459 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.info" returned: 0 in 0.744s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f5b5446b-9d73-4560-b917-226f5a1d9459 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.398s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:01 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-f5b5446b-9d73-4560-b917-226f5a1d9459 tempest-VolumesSnapshotTestJSON-488916833 None] Create snapshot completed successfully Jul 06 15:36:02 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-19718200-3b83-4c16-a221-fb5436e77765 tempest-VolumesListTestJSON-797449069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-65a668f4-b3e5-46d3-9e8a-314f1f5ed965" returned: 0 in 0.710s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:02 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-19718200-3b83-4c16-a221-fb5436e77765 tempest-VolumesListTestJSON-797449069 None] Lock "cinder-quobyte-65a668f4-b3e5-46d3-9e8a-314f1f5ed965" released by "delete_volume" :: held 1.941s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:02 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-19718200-3b83-4c16-a221-fb5436e77765 tempest-VolumesListTestJSON-797449069 None] Created reservations ['d3dfd397-917f-4552-9674-6d60a5763f51', 'a3231b3d-7401-4f6c-a5ae-9563372d268e', '6e95d207-6892-4841-8245-abd5bb0e930b', '40383ea6-5896-485a-b7a1-fa012aa0a9de'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:36:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-19718200-3b83-4c16-a221-fb5436e77765 tempest-VolumesListTestJSON-797449069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-19718200-3b83-4c16-a221-fb5436e77765 tempest-VolumesListTestJSON-797449069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:02 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-19718200-3b83-4c16-a221-fb5436e77765 tempest-VolumesListTestJSON-797449069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:02 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-19718200-3b83-4c16-a221-fb5436e77765 tempest-VolumesListTestJSON-797449069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-19718200-3b83-4c16-a221-fb5436e77765 tempest-VolumesListTestJSON-797449069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-19718200-3b83-4c16-a221-fb5436e77765 tempest-VolumesListTestJSON-797449069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:02 devstack sudo[97688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:36:02 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:02 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-43031a2d-2433-422a-9ea9-1b347226576e tempest-GroupSnapshotsTest-729188743 None] Group tempest-GroupSnapshotsTest-Group-1782807575: creating Jul 06 15:36:02 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-43031a2d-2433-422a-9ea9-1b347226576e tempest-GroupSnapshotsTest-729188743 None] Group tempest-GroupSnapshotsTest-Group-1782807575: created successfully Jul 06 15:36:02 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-43031a2d-2433-422a-9ea9-1b347226576e tempest-GroupSnapshotsTest-729188743 None] Create group completed successfully. Jul 06 15:36:02 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-19718200-3b83-4c16-a221-fb5436e77765 tempest-VolumesListTestJSON-797449069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.717s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:02 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-19718200-3b83-4c16-a221-fb5436e77765 tempest-VolumesListTestJSON-797449069 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:36:02 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-19718200-3b83-4c16-a221-fb5436e77765 tempest-VolumesListTestJSON-797449069 None] Deleted volume successfully. Jul 06 15:36:02 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-19718200-3b83-4c16-a221-fb5436e77765 tempest-VolumesListTestJSON-797449069 None] Lock "cinder-65a668f4-b3e5-46d3-9e8a-314f1f5ed965-delete_volume" released by "delete_volume" :: held 2.941s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:03 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-a7755320-d167-4a01-92cf-e20c5a44a136 req-a281178e-a347-438d-a300-839551ca2b4a tempest-TestStampPattern-150571277 None] Terminate volume connection completed successfully. Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-a7755320-d167-4a01-92cf-e20c5a44a136 req-a281178e-a347-438d-a300-839551ca2b4a tempest-TestStampPattern-150571277 None] Deleting attachment 8cfca0f3-5b6d-4351-97cd-b1cabd8bc35e. {{(pid=86148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Flow 'volume_create_manager' (e60c4831-ae30-430f-912c-8c00ef2838fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (580e9dbd-612f-43d0-b1c3-dd5d2bef0fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (580e9dbd-612f-43d0-b1c3-dd5d2bef0fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1866068228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a23824-5684-42e4-b405-ceffa09914c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b2df85079b34aacbc4881185ed9f331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f6082f13-1ff1-4f20-80ef-9a6385f2e305,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:03Z,use_quota=True,user_id='474277430b324c4c95f5f6c06a88054f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e9af96-755b-408f-883e-860c73d29bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e9af96-755b-408f-883e-860c73d29bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6442b2f-c102-4957-8e32-8958ff35b08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6442b2f-c102-4957-8e32-8958ff35b08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '05a23824-5684-42e4-b405-ceffa09914c0', 'volume_name': 'volume-05a23824-5684-42e4-b405-ceffa09914c0', 'volume_size': 1, 'snapshot_id': 'f6082f13-1ff1-4f20-80ef-9a6385f2e305'}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e4244e-a567-44d0-847a-98261dea521b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e4244e-a567-44d0-847a-98261dea521b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fec1eb8-36f7-4bac-981f-8d63f87645ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:03 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Volume 05a23824-5684-42e4-b405-ceffa09914c0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-05a23824-5684-42e4-b405-ceffa09914c0', 'volume_size': 1, 'snapshot_id': 'f6082f13-1ff1-4f20-80ef-9a6385f2e305'} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "cinder-quobyte-f6082f13-1ff1-4f20-80ef-9a6385f2e305-05a23824-5684-42e4-b405-ceffa09914c0" by "_create_volume_from_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-f6082f13-1ff1-4f20-80ef-9a6385f2e305-05a23824-5684-42e4-b405-ceffa09914c0" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Creating volume 05a23824-5684-42e4-b405-ceffa09914c0 from snapshot f6082f13-1ff1-4f20-80ef-9a6385f2e305 {{(pid=86148) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "cinder-quobyte-05a23824-5684-42e4-b405-ceffa09914c0" by "_copy_volume_from_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-05a23824-5684-42e4-b405-ceffa09914c0" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] snapshot: f6082f13-1ff1-4f20-80ef-9a6385f2e305, volume: 05a23824-5684-42e4-b405-ceffa09914c0, {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0045754-45ae-41c2-816e-a2bf0d64f99f]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.f6082f13-1ff1-4f20-80ef-9a6385f2e305 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:03 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.f6082f13-1ff1-4f20-80ef-9a6385f2e305 Jul 06 15:36:03 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:04 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:36:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Flow 'volume_create_manager' (6186f2cc-b0ee-4d70-a545-ee3675eec13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:36:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e31f8905-d7d1-4bf1-92e6-e0098bf473d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e31f8905-d7d1-4bf1-92e6-e0098bf473d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-161216442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7ea602ea-bfdf-4b3c-b648-2dc5515dba19,host='devstack@QuobyteHD#QuobyteHD',id=8da86705-bcf6-40bc-8053-3c6b7ebf4574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a2e8e36e05845e6b70b3678e743370c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:04Z,use_quota=True,user_id='cd3548cd12eb48df879c2b63da879e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(617845c7-39c3-43be-b77c-d25cbbef83e1),volume_type_id=617845c7-39c3-43be-b77c-d25cbbef83e1)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f371c1-7f02-4e4a-9b85-a49669b828c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f371c1-7f02-4e4a-9b85-a49669b828c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f845714f-d23c-4e4a-865b-cfbe956f7d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f845714f-d23c-4e4a-865b-cfbe956f7d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8da86705-bcf6-40bc-8053-3c6b7ebf4574', 'volume_name': 'volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f82821d-1da2-4c4e-828a-6a97db9dcdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f82821d-1da2-4c4e-828a-6a97db9dcdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e69453-b9fd-4c22-92db-9a8d39957b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:04 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Volume 8da86705-bcf6-40bc-8053-3c6b7ebf4574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574', 'volume_size': 1} Jul 06 15:36:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:04 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.f6082f13-1ff1-4f20-80ef-9a6385f2e305" returned: 0 in 0.966s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:04 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:36:04 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 15:36:04 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Creating direct copy from snapshot {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 15:36:04 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc0f850-47c2-4cc5-aafa-12fb7927e51c]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:04 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f Jul 06 15:36:04 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f9bf584e-7752-44f4-af70-64505c37f2b8 tempest-TestStampPattern-150571277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:05 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f" returned: 0 in 0.829s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:05 devstack cinder-volume[86148]: DEBUG cinder.utils [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Path /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-05a23824-5684-42e4-b405-ceffa09914c0 not found in is_blk_device check {{(pid=86148) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 15:36:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-05a23824-5684-42e4-b405-ceffa09914c0 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:05 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-05a23824-5684-42e4-b405-ceffa09914c0 Jul 06 15:36:05 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:05 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:36:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Flow 'volume_create_manager' (7b2ff451-f622-40f0-beb0-62d76836795e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:36:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80fe7bb0-9c71-4808-8abc-86086ee9efd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80fe7bb0-9c71-4808-8abc-86086ee9efd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1281614886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4cfb7f1-34ea-4ebc-bb93-d6b05a411721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2b87418b564dfd898c259f2b08a58b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:06Z,use_quota=True,user_id='340cca6e5617487395c35eaa3df621c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99fd5c15-9f23-469d-8eae-ab1afa9d04f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99fd5c15-9f23-469d-8eae-ab1afa9d04f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cde7f7b-700b-42af-9b33-3f0fba5ba574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cde7f7b-700b-42af-9b33-3f0fba5ba574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4cfb7f1-34ea-4ebc-bb93-d6b05a411721', 'volume_name': 'volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721', 'volume_size': 2}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18a88e02-03a5-4473-891b-9add888ea201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18a88e02-03a5-4473-891b-9add888ea201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e384065-3d70-4a39-b4d8-13d3cf9660cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:05 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Volume b4cfb7f1-34ea-4ebc-bb93-d6b05a411721: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721', 'volume_size': 2} Jul 06 15:36:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:09 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-05a23824-5684-42e4-b405-ceffa09914c0" returned: 0 in 4.377s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:09 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e397f4-1717-45af-87fb-5ac0842eb59a]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:09 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f Jul 06 15:36:09 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:10 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f" returned: 0 in 0.884s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:10 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f, size 1024.00 MB, duration 4.38 sec, destination /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-05a23824-5684-42e4-b405-ceffa09914c0 {{(pid=86148) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:36:10 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Converted 1024.00 MB image at 233.90 MB/s Jul 06 15:36:10 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-05a23824-5684-42e4-b405-ceffa09914c0 is being set with open permissions: ugo+rw Jul 06 15:36:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-05a23824-5684-42e4-b405-ceffa09914c0 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:10 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-05a23824-5684-42e4-b405-ceffa09914c0 Jul 06 15:36:10 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:11 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-05a23824-5684-42e4-b405-ceffa09914c0" returned: 0 in 0.620s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:11 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-05a23824-5684-42e4-b405-ceffa09914c0" released by "_copy_volume_from_snapshot" :: held 7.779s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:11 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-f6082f13-1ff1-4f20-80ef-9a6385f2e305-05a23824-5684-42e4-b405-ceffa09914c0" released by "_create_volume_from_snapshot" :: held 7.810s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.828s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.929s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7ea602ea-bfdf-4b3c-b648-2dc5515dba19,created_at=2026-07-06T13:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-161216442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7ea602ea-bfdf-4b3c-b648-2dc5515dba19,host='devstack@QuobyteHD#QuobyteHD',id=8da86705-bcf6-40bc-8053-3c6b7ebf4574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a2e8e36e05845e6b70b3678e743370c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:04Z,use_quota=True,user_id='cd3548cd12eb48df879c2b63da879e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(617845c7-39c3-43be-b77c-d25cbbef83e1),volume_type_id=617845c7-39c3-43be-b77c-d25cbbef83e1)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:36:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Creating volume 8da86705-bcf6-40bc-8053-3c6b7ebf4574 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:36:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:36:11 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:36:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:11 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574 1073741824 Jul 06 15:36:11 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fec1eb8-36f7-4bac-981f-8d63f87645ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05a23824-5684-42e4-b405-ceffa09914c0', 'volume_size': 1, 'snapshot_id': 'f6082f13-1ff1-4f20-80ef-9a6385f2e305'}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (797a322d-af92-428c-9c9b-b235889aa7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:11 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Volume volume-05a23824-5684-42e4-b405-ceffa09914c0 (05a23824-5684-42e4-b405-ceffa09914c0): created successfully Jul 06 15:36:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (797a322d-af92-428c-9c9b-b235889aa7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Flow 'volume_create_manager' (e60c4831-ae30-430f-912c-8c00ef2838fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:36:11 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-5b88e02c-38b9-4ccc-bc14-898b6aa5e99a tempest-VolumesSnapshotTestJSON-488916833 None] Created volume successfully. Jul 06 15:36:12 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a76d492e-4cbc-4a93-88f9-5b3516401336 tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "cinder-05a23824-5684-42e4-b405-ceffa09914c0-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:12 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a76d492e-4cbc-4a93-88f9-5b3516401336 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-05a23824-5684-42e4-b405-ceffa09914c0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:12 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a76d492e-4cbc-4a93-88f9-5b3516401336 tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "cinder-quobyte-05a23824-5684-42e4-b405-ceffa09914c0" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:12 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a76d492e-4cbc-4a93-88f9-5b3516401336 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-05a23824-5684-42e4-b405-ceffa09914c0" acquired by "delete_volume" :: waited 0.026s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:12 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bb18eb-1a62-4028-a8c4-d44f4481827a]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a76d492e-4cbc-4a93-88f9-5b3516401336 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-05a23824-5684-42e4-b405-ceffa09914c0 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:12 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574 1073741824" returned: 0 in 0.942s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:12 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-05a23824-5684-42e4-b405-ceffa09914c0 Jul 06 15:36:12 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:12 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574 Jul 06 15:36:12 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:12 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574" returned: 0 in 0.690s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:36:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f9bf584e-7752-44f4-af70-64505c37f2b8 tempest-TestStampPattern-150571277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.663s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:12 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a76d492e-4cbc-4a93-88f9-5b3516401336 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-05a23824-5684-42e4-b405-ceffa09914c0" returned: 0 in 0.841s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a76d492e-4cbc-4a93-88f9-5b3516401336 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-05a23824-5684-42e4-b405-ceffa09914c0 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e69453-b9fd-4c22-92db-9a8d39957b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd54f40-40d5-41ff-b6fe-d40316deaa9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:13 devstack sudo[97767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-05a23824-5684-42e4-b405-ceffa09914c0 Jul 06 15:36:13 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:13 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-f9bf584e-7752-44f4-af70-64505c37f2b8 tempest-TestStampPattern-150571277 None] Creating offline snapshot 4c9f30d1-0009-4e41-b6ff-41f2a20c0103 of volume 5c568390-9d78-48fe-845c-2f90ff72701b {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:36:13 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Volume volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574 (8da86705-bcf6-40bc-8053-3c6b7ebf4574): created successfully Jul 06 15:36:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd54f40-40d5-41ff-b6fe-d40316deaa9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Flow 'volume_create_manager' (6186f2cc-b0ee-4d70-a545-ee3675eec13b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:36:13 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a064676-b012-4c9a-8205-1a06dea1e5bc]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f9bf584e-7752-44f4-af70-64505c37f2b8 tempest-TestStampPattern-150571277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:13 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-f94965b3-bf7f-4fe9-ae3b-8926e6edb7b4 tempest-GroupSnapshotsTest-729188743 None] Created volume successfully. Jul 06 15:36:13 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b Jul 06 15:36:13 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:13 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a76d492e-4cbc-4a93-88f9-5b3516401336 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-05a23824-5684-42e4-b405-ceffa09914c0" returned: 0 in 0.661s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:13 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a76d492e-4cbc-4a93-88f9-5b3516401336 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-05a23824-5684-42e4-b405-ceffa09914c0" released by "delete_volume" :: held 1.554s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:13 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-a76d492e-4cbc-4a93-88f9-5b3516401336 tempest-VolumesSnapshotTestJSON-488916833 None] Created reservations ['e19159af-479f-4615-b482-9dc59e42ad38', '914b8e41-6ec4-41f0-a3c5-56f70d8ee19e', '9957f4d1-2548-4201-8d60-88fe0d3282ea', '40f6f5f3-483e-4515-9c0c-14318b21fa77'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:36:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a76d492e-4cbc-4a93-88f9-5b3516401336 tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a76d492e-4cbc-4a93-88f9-5b3516401336 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:13 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a76d492e-4cbc-4a93-88f9-5b3516401336 tempest-VolumesSnapshotTestJSON-488916833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:13 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a76d492e-4cbc-4a93-88f9-5b3516401336 tempest-VolumesSnapshotTestJSON-488916833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a76d492e-4cbc-4a93-88f9-5b3516401336 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a76d492e-4cbc-4a93-88f9-5b3516401336 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:13 devstack sudo[97775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:36:13 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:13 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f9bf584e-7752-44f4-af70-64505c37f2b8 tempest-TestStampPattern-150571277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b" returned: 0 in 0.775s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f9bf584e-7752-44f4-af70-64505c37f2b8 tempest-TestStampPattern-150571277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.4c9f30d1-0009-4e41-b6ff-41f2a20c0103 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:13 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.4c9f30d1-0009-4e41-b6ff-41f2a20c0103 1G Jul 06 15:36:13 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:14 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-312ab261-37b9-4025-9590-d7237a3ea160 tempest-GroupSnapshotsTest-729188743 None] GroupSnapshot 25531419-d45e-4fcd-8572-6de95390d4a9: creating. Jul 06 15:36:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-312ab261-37b9-4025-9590-d7237a3ea160 tempest-GroupSnapshotsTest-729188743 None] Group snapshot 25531419-d45e-4fcd-8572-6de95390d4a9: creating. {{(pid=86148) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 15:36:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-312ab261-37b9-4025-9590-d7237a3ea160 tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-46cdc487-d9f7-4ed1-93da-b5d0b045a5d7 tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "cinder-f6082f13-1ff1-4f20-80ef-9a6385f2e305-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-46cdc487-d9f7-4ed1-93da-b5d0b045a5d7 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-f6082f13-1ff1-4f20-80ef-9a6385f2e305-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-46cdc487-d9f7-4ed1-93da-b5d0b045a5d7 tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "cinder-quobyte-1137081c-f0b6-4a08-99e1-14e8dd73c59f" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:14 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a76d492e-4cbc-4a93-88f9-5b3516401336 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.688s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:14 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-a76d492e-4cbc-4a93-88f9-5b3516401336 tempest-VolumesSnapshotTestJSON-488916833 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:36:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-46cdc487-d9f7-4ed1-93da-b5d0b045a5d7 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-1137081c-f0b6-4a08-99e1-14e8dd73c59f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-46cdc487-d9f7-4ed1-93da-b5d0b045a5d7 tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "cinder-quobyte-f6082f13-1ff1-4f20-80ef-9a6385f2e305" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:14 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a76d492e-4cbc-4a93-88f9-5b3516401336 tempest-VolumesSnapshotTestJSON-488916833 None] Deleted volume successfully. Jul 06 15:36:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-46cdc487-d9f7-4ed1-93da-b5d0b045a5d7 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-f6082f13-1ff1-4f20-80ef-9a6385f2e305" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-46cdc487-d9f7-4ed1-93da-b5d0b045a5d7 tempest-VolumesSnapshotTestJSON-488916833 None] Deleting offline snapshot f6082f13-1ff1-4f20-80ef-9a6385f2e305 of volume 1137081c-f0b6-4a08-99e1-14e8dd73c59f {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:36:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-46cdc487-d9f7-4ed1-93da-b5d0b045a5d7 tempest-VolumesSnapshotTestJSON-488916833 None] snapshot_file for this snap is: volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.f6082f13-1ff1-4f20-80ef-9a6385f2e305 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:36:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a76d492e-4cbc-4a93-88f9-5b3516401336 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-05a23824-5684-42e4-b405-ceffa09914c0-delete_volume" released by "delete_volume" :: held 2.484s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:14 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1375d4-d41d-453b-97c9-7a41823342b0]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-46cdc487-d9f7-4ed1-93da-b5d0b045a5d7 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.f6082f13-1ff1-4f20-80ef-9a6385f2e305 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:14 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.f6082f13-1ff1-4f20-80ef-9a6385f2e305 Jul 06 15:36:14 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:14 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f9bf584e-7752-44f4-af70-64505c37f2b8 tempest-TestStampPattern-150571277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.4c9f30d1-0009-4e41-b6ff-41f2a20c0103 1G" returned: 0 in 0.883s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f9bf584e-7752-44f4-af70-64505c37f2b8 tempest-TestStampPattern-150571277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c568390-9d78-48fe-845c-2f90ff72701b -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.4c9f30d1-0009-4e41-b6ff-41f2a20c0103 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:14 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c568390-9d78-48fe-845c-2f90ff72701b -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.4c9f30d1-0009-4e41-b6ff-41f2a20c0103 Jul 06 15:36:14 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:15 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-46cdc487-d9f7-4ed1-93da-b5d0b045a5d7 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.f6082f13-1ff1-4f20-80ef-9a6385f2e305" returned: 0 in 0.730s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:15 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-46cdc487-d9f7-4ed1-93da-b5d0b045a5d7 tempest-VolumesSnapshotTestJSON-488916833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:36:15 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3388801-0bce-4c55-9d28-759629240a2b]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-46cdc487-d9f7-4ed1-93da-b5d0b045a5d7 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:15 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f Jul 06 15:36:15 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:15 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f9bf584e-7752-44f4-af70-64505c37f2b8 tempest-TestStampPattern-150571277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c568390-9d78-48fe-845c-2f90ff72701b -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.4c9f30d1-0009-4e41-b6ff-41f2a20c0103" returned: 0 in 0.678s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:15 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-f9bf584e-7752-44f4-af70-64505c37f2b8 tempest-TestStampPattern-150571277 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.4c9f30d1-0009-4e41-b6ff-41f2a20c0103 is being set with open permissions: ugo+rw Jul 06 15:36:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f9bf584e-7752-44f4-af70-64505c37f2b8 tempest-TestStampPattern-150571277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.4c9f30d1-0009-4e41-b6ff-41f2a20c0103 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:15 devstack sudo[97797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.4c9f30d1-0009-4e41-b6ff-41f2a20c0103 Jul 06 15:36:15 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:16 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-46cdc487-d9f7-4ed1-93da-b5d0b045a5d7 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f" returned: 0 in 0.744s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-46cdc487-d9f7-4ed1-93da-b5d0b045a5d7 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.f6082f13-1ff1-4f20-80ef-9a6385f2e305 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:16 devstack sudo[97803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.f6082f13-1ff1-4f20-80ef-9a6385f2e305 Jul 06 15:36:16 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:16 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f9bf584e-7752-44f4-af70-64505c37f2b8 tempest-TestStampPattern-150571277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.4c9f30d1-0009-4e41-b6ff-41f2a20c0103" returned: 0 in 0.658s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f9bf584e-7752-44f4-af70-64505c37f2b8 tempest-TestStampPattern-150571277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:16 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.info Jul 06 15:36:16 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:16 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f9bf584e-7752-44f4-af70-64505c37f2b8 tempest-TestStampPattern-150571277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.info" returned: 0 in 0.616s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:16 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-f9bf584e-7752-44f4-af70-64505c37f2b8 tempest-TestStampPattern-150571277 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.info is being set with open permissions: ugo+rw Jul 06 15:36:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f9bf584e-7752-44f4-af70-64505c37f2b8 tempest-TestStampPattern-150571277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:16 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-46cdc487-d9f7-4ed1-93da-b5d0b045a5d7 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.f6082f13-1ff1-4f20-80ef-9a6385f2e305" returned: 0 in 0.696s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-46cdc487-d9f7-4ed1-93da-b5d0b045a5d7 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.f6082f13-1ff1-4f20-80ef-9a6385f2e305 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:16 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.info Jul 06 15:36:16 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:16 devstack sudo[97813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.f6082f13-1ff1-4f20-80ef-9a6385f2e305 Jul 06 15:36:16 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:17 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f9bf584e-7752-44f4-af70-64505c37f2b8 tempest-TestStampPattern-150571277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.info" returned: 0 in 0.619s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:17 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f9bf584e-7752-44f4-af70-64505c37f2b8 tempest-TestStampPattern-150571277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.377s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.433s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:17 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1281614886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4cfb7f1-34ea-4ebc-bb93-d6b05a411721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2b87418b564dfd898c259f2b08a58b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:06Z,use_quota=True,user_id='340cca6e5617487395c35eaa3df621c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:36:17 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Creating volume b4cfb7f1-34ea-4ebc-bb93-d6b05a411721 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:36:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:17 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:17 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:17 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:36:17 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:36:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721 2147483648 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-46cdc487-d9f7-4ed1-93da-b5d0b045a5d7 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f.f6082f13-1ff1-4f20-80ef-9a6385f2e305" returned: 0 in 0.635s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:17 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721 2147483648 Jul 06 15:36:17 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:17 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-46cdc487-d9f7-4ed1-93da-b5d0b045a5d7 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-f6082f13-1ff1-4f20-80ef-9a6385f2e305" released by "_delete_snapshot" :: held 2.916s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:17 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-f9bf584e-7752-44f4-af70-64505c37f2b8 tempest-TestStampPattern-150571277 None] Create snapshot completed successfully Jul 06 15:36:17 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-46cdc487-d9f7-4ed1-93da-b5d0b045a5d7 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-1137081c-f0b6-4a08-99e1-14e8dd73c59f" released by "delete_snapshot" :: held 2.948s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:17 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-46cdc487-d9f7-4ed1-93da-b5d0b045a5d7 tempest-VolumesSnapshotTestJSON-488916833 None] Created reservations ['e0ec45a8-04ed-45ae-be66-fa4a5a05584e', '2d204b43-6d9e-4349-95e8-aebe9ef4d6ac', 'f0a5242a-4b3a-4281-aad5-3ed8f98b1e44', '80bb1088-0fdf-44e7-89b1-9b48d37d9369'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:36:17 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-46cdc487-d9f7-4ed1-93da-b5d0b045a5d7 tempest-VolumesSnapshotTestJSON-488916833 None] Delete snapshot completed successfully. Jul 06 15:36:17 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-46cdc487-d9f7-4ed1-93da-b5d0b045a5d7 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-f6082f13-1ff1-4f20-80ef-9a6385f2e305-delete_snapshot" released by "delete_snapshot" :: held 3.095s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:17 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e9c7fc70-573e-4544-94fd-9ea9d65902e8 tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "cinder-1137081c-f0b6-4a08-99e1-14e8dd73c59f-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:17 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e9c7fc70-573e-4544-94fd-9ea9d65902e8 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-1137081c-f0b6-4a08-99e1-14e8dd73c59f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:17 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e9c7fc70-573e-4544-94fd-9ea9d65902e8 tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "cinder-quobyte-1137081c-f0b6-4a08-99e1-14e8dd73c59f" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:17 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e9c7fc70-573e-4544-94fd-9ea9d65902e8 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-1137081c-f0b6-4a08-99e1-14e8dd73c59f" acquired by "delete_volume" :: waited 0.020s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:17 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[e134386e-526c-42c6-8343-bc07bbdd95cd]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e9c7fc70-573e-4544-94fd-9ea9d65902e8 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:17 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f Jul 06 15:36:17 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:18 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721 2147483648" returned: 0 in 0.917s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:18 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721 Jul 06 15:36:18 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:18 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e9c7fc70-573e-4544-94fd-9ea9d65902e8 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f" returned: 0 in 0.773s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e9c7fc70-573e-4544-94fd-9ea9d65902e8 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:18 devstack sudo[97829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f Jul 06 15:36:18 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:18 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721" returned: 0 in 0.672s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:18 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:36:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-312ab261-37b9-4025-9590-d7237a3ea160 tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.597s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:18 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e384065-3d70-4a39-b4d8-13d3cf9660cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721', 'volume_size': 2}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:18 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (136fff9b-0be1-49b4-bea2-a4ef7ccbdeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:18 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-312ab261-37b9-4025-9590-d7237a3ea160 tempest-GroupSnapshotsTest-729188743 None] Creating offline snapshot b94b500e-d845-4f07-a1a3-50522076907b of volume 8da86705-bcf6-40bc-8053-3c6b7ebf4574 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:36:19 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Volume volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721 (b4cfb7f1-34ea-4ebc-bb93-d6b05a411721): created successfully Jul 06 15:36:19 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (136fff9b-0be1-49b4-bea2-a4ef7ccbdeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:19 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Flow 'volume_create_manager' (7b2ff451-f622-40f0-beb0-62d76836795e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:36:19 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a3c761-2ee4-473b-b5f0-1ce00e5c2017]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-312ab261-37b9-4025-9590-d7237a3ea160 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:19 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-60823891-d15d-4331-8298-733018850a5e tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Created volume successfully. Jul 06 15:36:19 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574 Jul 06 15:36:19 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:19 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e9c7fc70-573e-4544-94fd-9ea9d65902e8 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1137081c-f0b6-4a08-99e1-14e8dd73c59f" returned: 0 in 0.722s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e9c7fc70-573e-4544-94fd-9ea9d65902e8 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-1137081c-f0b6-4a08-99e1-14e8dd73c59f" released by "delete_volume" :: held 1.565s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:19 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-e9c7fc70-573e-4544-94fd-9ea9d65902e8 tempest-VolumesSnapshotTestJSON-488916833 None] Created reservations ['76ef8379-2238-434f-ac7e-7e8c61f725d2', 'e5bde039-498f-4a4c-b6ba-85ef8cab4611', '8e4b88c8-e2bc-493e-a2c1-57730cf64b12', 'a09472c6-419a-4bf1-aada-6d77d0530955'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:36:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e9c7fc70-573e-4544-94fd-9ea9d65902e8 tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e9c7fc70-573e-4544-94fd-9ea9d65902e8 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:19 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e9c7fc70-573e-4544-94fd-9ea9d65902e8 tempest-VolumesSnapshotTestJSON-488916833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:19 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e9c7fc70-573e-4544-94fd-9ea9d65902e8 tempest-VolumesSnapshotTestJSON-488916833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e9c7fc70-573e-4544-94fd-9ea9d65902e8 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e9c7fc70-573e-4544-94fd-9ea9d65902e8 tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:19 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:36:19 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:19 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-312ab261-37b9-4025-9590-d7237a3ea160 tempest-GroupSnapshotsTest-729188743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574" returned: 0 in 0.776s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-312ab261-37b9-4025-9590-d7237a3ea160 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.b94b500e-d845-4f07-a1a3-50522076907b 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:19 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.b94b500e-d845-4f07-a1a3-50522076907b 1G Jul 06 15:36:19 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:20 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5848df54-fc5d-4a1b-9975-11cf8ac2057f tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "cinder-b015a3b8-21ab-4bbc-85fb-1e515a5dff69-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:20 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5848df54-fc5d-4a1b-9975-11cf8ac2057f tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-b015a3b8-21ab-4bbc-85fb-1e515a5dff69-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1048513e-0bc0-4f37-84b0-8b434725eb06 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:20 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5848df54-fc5d-4a1b-9975-11cf8ac2057f tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "cinder-quobyte-b015a3b8-21ab-4bbc-85fb-1e515a5dff69" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:20 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5848df54-fc5d-4a1b-9975-11cf8ac2057f tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-b015a3b8-21ab-4bbc-85fb-1e515a5dff69" acquired by "delete_volume" :: waited 0.020s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:20 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e9c7fc70-573e-4544-94fd-9ea9d65902e8 tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.759s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:20 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-e9c7fc70-573e-4544-94fd-9ea9d65902e8 tempest-VolumesSnapshotTestJSON-488916833 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:36:20 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-e9c7fc70-573e-4544-94fd-9ea9d65902e8 tempest-VolumesSnapshotTestJSON-488916833 None] Deleted volume successfully. Jul 06 15:36:20 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb19466-4767-4ac4-be86-18fa50e462d1]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5848df54-fc5d-4a1b-9975-11cf8ac2057f tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:20 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e9c7fc70-573e-4544-94fd-9ea9d65902e8 tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-1137081c-f0b6-4a08-99e1-14e8dd73c59f-delete_volume" released by "delete_volume" :: held 2.537s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:20 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69 Jul 06 15:36:20 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:20 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-312ab261-37b9-4025-9590-d7237a3ea160 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.b94b500e-d845-4f07-a1a3-50522076907b 1G" returned: 0 in 0.907s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-312ab261-37b9-4025-9590-d7237a3ea160 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.b94b500e-d845-4f07-a1a3-50522076907b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:20 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.b94b500e-d845-4f07-a1a3-50522076907b Jul 06 15:36:20 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:21 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5848df54-fc5d-4a1b-9975-11cf8ac2057f tempest-VolumesSnapshotTestJSON-488916833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69" returned: 0 in 0.791s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5848df54-fc5d-4a1b-9975-11cf8ac2057f tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:21 devstack sudo[97855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69 Jul 06 15:36:21 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:21 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-312ab261-37b9-4025-9590-d7237a3ea160 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.b94b500e-d845-4f07-a1a3-50522076907b" returned: 0 in 0.647s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:21 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-312ab261-37b9-4025-9590-d7237a3ea160 tempest-GroupSnapshotsTest-729188743 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.b94b500e-d845-4f07-a1a3-50522076907b is being set with open permissions: ugo+rw: NotImplementedError Jul 06 15:36:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-312ab261-37b9-4025-9590-d7237a3ea160 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.b94b500e-d845-4f07-a1a3-50522076907b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:21 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.b94b500e-d845-4f07-a1a3-50522076907b Jul 06 15:36:21 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:21 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5848df54-fc5d-4a1b-9975-11cf8ac2057f tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b015a3b8-21ab-4bbc-85fb-1e515a5dff69" returned: 0 in 0.622s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:21 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5848df54-fc5d-4a1b-9975-11cf8ac2057f tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-quobyte-b015a3b8-21ab-4bbc-85fb-1e515a5dff69" released by "delete_volume" :: held 1.482s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:21 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-5848df54-fc5d-4a1b-9975-11cf8ac2057f tempest-VolumesSnapshotTestJSON-488916833 None] Created reservations ['13fd5903-ce3e-49e8-baf6-119de1ecf784', 'f584ac1b-76ec-4c91-a6ef-3e5c6edb9808', '06b83096-cc06-4704-b5d4-e1c6a9c37dab', 'ef7df5a0-7677-42bd-bacf-45e28ba69101'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:36:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5848df54-fc5d-4a1b-9975-11cf8ac2057f tempest-VolumesSnapshotTestJSON-488916833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5848df54-fc5d-4a1b-9975-11cf8ac2057f tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5848df54-fc5d-4a1b-9975-11cf8ac2057f tempest-VolumesSnapshotTestJSON-488916833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5848df54-fc5d-4a1b-9975-11cf8ac2057f tempest-VolumesSnapshotTestJSON-488916833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5848df54-fc5d-4a1b-9975-11cf8ac2057f tempest-VolumesSnapshotTestJSON-488916833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5848df54-fc5d-4a1b-9975-11cf8ac2057f tempest-VolumesSnapshotTestJSON-488916833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:21 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:36:21 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:21 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-312ab261-37b9-4025-9590-d7237a3ea160 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.b94b500e-d845-4f07-a1a3-50522076907b" returned: 0 in 0.615s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-312ab261-37b9-4025-9590-d7237a3ea160 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:22 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.info Jul 06 15:36:22 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:22 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5848df54-fc5d-4a1b-9975-11cf8ac2057f tempest-VolumesSnapshotTestJSON-488916833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.689s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:22 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-5848df54-fc5d-4a1b-9975-11cf8ac2057f tempest-VolumesSnapshotTestJSON-488916833 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:36:22 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-5848df54-fc5d-4a1b-9975-11cf8ac2057f tempest-VolumesSnapshotTestJSON-488916833 None] Deleted volume successfully. Jul 06 15:36:22 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5848df54-fc5d-4a1b-9975-11cf8ac2057f tempest-VolumesSnapshotTestJSON-488916833 None] Lock "cinder-b015a3b8-21ab-4bbc-85fb-1e515a5dff69-delete_volume" released by "delete_volume" :: held 2.442s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:22 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-312ab261-37b9-4025-9590-d7237a3ea160 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.info" returned: 0 in 0.684s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:22 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-312ab261-37b9-4025-9590-d7237a3ea160 tempest-GroupSnapshotsTest-729188743 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 15:36:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-312ab261-37b9-4025-9590-d7237a3ea160 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:22 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.info Jul 06 15:36:22 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:23 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-312ab261-37b9-4025-9590-d7237a3ea160 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.info" returned: 0 in 0.713s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-312ab261-37b9-4025-9590-d7237a3ea160 tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.452s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1048513e-0bc0-4f37-84b0-8b434725eb06 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.276s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-1048513e-0bc0-4f37-84b0-8b434725eb06 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Creating offline snapshot ab03ab1c-5692-4257-bc96-7f64f736695d of volume b4cfb7f1-34ea-4ebc-bb93-d6b05a411721 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:36:23 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c43166-125a-4419-b295-2a34667be853]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1048513e-0bc0-4f37-84b0-8b434725eb06 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:23 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-312ab261-37b9-4025-9590-d7237a3ea160 tempest-GroupSnapshotsTest-729188743 None] group_snapshot 25531419-d45e-4fcd-8572-6de95390d4a9: created successfully Jul 06 15:36:23 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721 Jul 06 15:36:23 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:24 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1048513e-0bc0-4f37-84b0-8b434725eb06 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721" returned: 0 in 0.857s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1048513e-0bc0-4f37-84b0-8b434725eb06 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721.ab03ab1c-5692-4257-bc96-7f64f736695d 2G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:24 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721.ab03ab1c-5692-4257-bc96-7f64f736695d 2G Jul 06 15:36:24 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:25 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1048513e-0bc0-4f37-84b0-8b434725eb06 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721.ab03ab1c-5692-4257-bc96-7f64f736695d 2G" returned: 0 in 1.016s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1048513e-0bc0-4f37-84b0-8b434725eb06 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721.ab03ab1c-5692-4257-bc96-7f64f736695d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:25 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721.ab03ab1c-5692-4257-bc96-7f64f736695d Jul 06 15:36:25 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:26 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1048513e-0bc0-4f37-84b0-8b434725eb06 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721.ab03ab1c-5692-4257-bc96-7f64f736695d" returned: 0 in 0.841s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:26 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-1048513e-0bc0-4f37-84b0-8b434725eb06 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721.ab03ab1c-5692-4257-bc96-7f64f736695d is being set with open permissions: ugo+rw Jul 06 15:36:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1048513e-0bc0-4f37-84b0-8b434725eb06 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721.ab03ab1c-5692-4257-bc96-7f64f736695d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:26 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721.ab03ab1c-5692-4257-bc96-7f64f736695d Jul 06 15:36:26 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:26 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1048513e-0bc0-4f37-84b0-8b434725eb06 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721.ab03ab1c-5692-4257-bc96-7f64f736695d" returned: 0 in 0.734s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1048513e-0bc0-4f37-84b0-8b434725eb06 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:26 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721.info Jul 06 15:36:26 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:27 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1048513e-0bc0-4f37-84b0-8b434725eb06 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721.info" returned: 0 in 0.777s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:27 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-1048513e-0bc0-4f37-84b0-8b434725eb06 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721.info is being set with open permissions: ugo+rw Jul 06 15:36:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1048513e-0bc0-4f37-84b0-8b434725eb06 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:27 devstack sudo[97941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721.info Jul 06 15:36:27 devstack sudo[97941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:28 devstack sudo[97941]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1048513e-0bc0-4f37-84b0-8b434725eb06 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721.info" returned: 0 in 0.669s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1048513e-0bc0-4f37-84b0-8b434725eb06 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.019s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.494s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "cinder-quobyte-b94b500e-d845-4f07-a1a3-50522076907b-d3dee007-4f1a-4c76-9a71-a21a6c5cc7aa" by "_create_volume_from_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-b94b500e-d845-4f07-a1a3-50522076907b-d3dee007-4f1a-4c76-9a71-a21a6c5cc7aa" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Creating volume d3dee007-4f1a-4c76-9a71-a21a6c5cc7aa from snapshot b94b500e-d845-4f07-a1a3-50522076907b {{(pid=86148) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "cinder-quobyte-d3dee007-4f1a-4c76-9a71-a21a6c5cc7aa" by "_copy_volume_from_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:28 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-1048513e-0bc0-4f37-84b0-8b434725eb06 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Create snapshot completed successfully Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-d3dee007-4f1a-4c76-9a71-a21a6c5cc7aa" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] snapshot: b94b500e-d845-4f07-a1a3-50522076907b, volume: d3dee007-4f1a-4c76-9a71-a21a6c5cc7aa, {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1d71fd-9e95-4d57-b561-4fd3c5d47827]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.b94b500e-d845-4f07-a1a3-50522076907b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:28 devstack sudo[97944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.b94b500e-d845-4f07-a1a3-50522076907b Jul 06 15:36:28 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Flow 'volume_create_manager' (7e5b75d7-7372-41dc-8598-acf963edb53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0bedf1d-2bc2-4248-9a9b-7a4afbf557e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0bedf1d-2bc2-4248-9a9b-7a4afbf557e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1780169839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8132a75d-0fb3-4d8f-b2b2-d286de8595f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbfa0829fd58449a877989117e0038c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4c9f30d1-0009-4e41-b6ff-41f2a20c0103,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:29Z,use_quota=True,user_id='9963f3ddbdf04eac866d7d1a66ca81c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4775f314-e165-4f93-8e66-309e8a03b959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4775f314-e165-4f93-8e66-309e8a03b959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (701aacb1-fd7c-40fa-bde8-2b01b437884d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (701aacb1-fd7c-40fa-bde8-2b01b437884d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8132a75d-0fb3-4d8f-b2b2-d286de8595f9', 'volume_name': 'volume-8132a75d-0fb3-4d8f-b2b2-d286de8595f9', 'volume_size': 1, 'snapshot_id': '4c9f30d1-0009-4e41-b6ff-41f2a20c0103'}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88ef943-287c-49f2-98c5-a45dbb8fa821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88ef943-287c-49f2-98c5-a45dbb8fa821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4ed6115-4acd-402d-9774-887c59a4fd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:29 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Volume 8132a75d-0fb3-4d8f-b2b2-d286de8595f9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8132a75d-0fb3-4d8f-b2b2-d286de8595f9', 'volume_size': 1, 'snapshot_id': '4c9f30d1-0009-4e41-b6ff-41f2a20c0103'} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:29 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.b94b500e-d845-4f07-a1a3-50522076907b" returned: 0 in 0.923s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574 {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Creating direct copy from snapshot {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[90de5d92-1a3e-40e9-a5a9-a5f5a86d6dd0]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Flow 'volume_create_manager' (21b9016c-7a6b-4917-a18b-e4dbe0cb3da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:36:29 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574 Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7388e792-bba1-4ae5-a872-22531013c0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:29 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ce0845b2-f0ca-4e3d-9870-bd79d8247083 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Acquiring lock "cinder-ab03ab1c-5692-4257-bc96-7f64f736695d-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7388e792-bba1-4ae5-a872-22531013c0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-631044312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da52aa0-ca1e-4008-89e8-3cd1395743f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f03cc8bb0a4c129bd396fa32f11012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:29Z,use_quota=True,user_id='7fa98b98610344dea1bf7cf30b9dc06f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9927a001-9812-41a3-8764-6c3b996cb248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9927a001-9812-41a3-8764-6c3b996cb248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7ff9fb-9f23-4533-b8ce-d4c28043736d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7ff9fb-9f23-4533-b8ce-d4c28043736d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0da52aa0-ca1e-4008-89e8-3cd1395743f2', 'volume_name': 'volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2e6412a-29a6-4834-9bba-ba06fb2b5cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2e6412a-29a6-4834-9bba-ba06fb2b5cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b754863b-d09d-4dc8-b2a5-4f89cb79db58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:29 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Volume 0da52aa0-ca1e-4008-89e8-3cd1395743f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2', 'volume_size': 1} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ce0845b2-f0ca-4e3d-9870-bd79d8247083 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Lock "cinder-ab03ab1c-5692-4257-bc96-7f64f736695d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.081s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ce0845b2-f0ca-4e3d-9870-bd79d8247083 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Acquiring lock "cinder-quobyte-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ce0845b2-f0ca-4e3d-9870-bd79d8247083 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Lock "cinder-quobyte-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ce0845b2-f0ca-4e3d-9870-bd79d8247083 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Acquiring lock "cinder-quobyte-ab03ab1c-5692-4257-bc96-7f64f736695d" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ce0845b2-f0ca-4e3d-9870-bd79d8247083 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Lock "cinder-quobyte-ab03ab1c-5692-4257-bc96-7f64f736695d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-ce0845b2-f0ca-4e3d-9870-bd79d8247083 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Deleting offline snapshot ab03ab1c-5692-4257-bc96-7f64f736695d of volume b4cfb7f1-34ea-4ebc-bb93-d6b05a411721 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-ce0845b2-f0ca-4e3d-9870-bd79d8247083 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] snapshot_file for this snap is: volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721.ab03ab1c-5692-4257-bc96-7f64f736695d {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a427d4-d394-4e74-90aa-66677b1a7fac]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ce0845b2-f0ca-4e3d-9870-bd79d8247083 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721.ab03ab1c-5692-4257-bc96-7f64f736695d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:29 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721.ab03ab1c-5692-4257-bc96-7f64f736695d Jul 06 15:36:29 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:30 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574" returned: 0 in 0.861s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:30 devstack cinder-volume[86148]: DEBUG cinder.utils [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Path /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3dee007-4f1a-4c76-9a71-a21a6c5cc7aa not found in is_blk_device check {{(pid=86148) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 15:36:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3dee007-4f1a-4c76-9a71-a21a6c5cc7aa {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:30 devstack sudo[97961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3dee007-4f1a-4c76-9a71-a21a6c5cc7aa Jul 06 15:36:30 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:30 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ce0845b2-f0ca-4e3d-9870-bd79d8247083 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721.ab03ab1c-5692-4257-bc96-7f64f736695d" returned: 0 in 0.838s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-ce0845b2-f0ca-4e3d-9870-bd79d8247083 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:36:30 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72d9975-9396-46c9-ab7e-21280ef18f66]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ce0845b2-f0ca-4e3d-9870-bd79d8247083 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:30 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721 Jul 06 15:36:30 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:31 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ce0845b2-f0ca-4e3d-9870-bd79d8247083 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721" returned: 0 in 1.182s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ce0845b2-f0ca-4e3d-9870-bd79d8247083 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721.ab03ab1c-5692-4257-bc96-7f64f736695d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:31 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721.ab03ab1c-5692-4257-bc96-7f64f736695d Jul 06 15:36:31 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:33 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ce0845b2-f0ca-4e3d-9870-bd79d8247083 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721.ab03ab1c-5692-4257-bc96-7f64f736695d" returned: 0 in 1.833s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ce0845b2-f0ca-4e3d-9870-bd79d8247083 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721.ab03ab1c-5692-4257-bc96-7f64f736695d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:33 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721.ab03ab1c-5692-4257-bc96-7f64f736695d Jul 06 15:36:33 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:35 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ce0845b2-f0ca-4e3d-9870-bd79d8247083 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721.ab03ab1c-5692-4257-bc96-7f64f736695d" returned: 0 in 1.348s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:35 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=113,cinder:UPDATE=125,cinder:INSERT=31,cinder:DELETE=14 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:36:35 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:DELETE=9,cinder:SELECT=114,cinder:INSERT=31,cinder:UPDATE=137 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:36:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ce0845b2-f0ca-4e3d-9870-bd79d8247083 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Lock "cinder-quobyte-ab03ab1c-5692-4257-bc96-7f64f736695d" released by "_delete_snapshot" :: held 5.381s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ce0845b2-f0ca-4e3d-9870-bd79d8247083 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Lock "cinder-quobyte-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721" released by "delete_snapshot" :: held 5.437s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:35 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-ce0845b2-f0ca-4e3d-9870-bd79d8247083 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Created reservations ['be3754f4-65f8-48cd-914f-ba530d318221', '07476879-802c-47da-a148-c18bf40ab7a9', '26f11ba3-18e1-4228-b0bf-7a3248890cd0', '4a43bf0f-6412-4826-b935-c10f4cbeac46'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:36:35 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-ce0845b2-f0ca-4e3d-9870-bd79d8247083 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Delete snapshot completed successfully. Jul 06 15:36:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ce0845b2-f0ca-4e3d-9870-bd79d8247083 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Lock "cinder-ab03ab1c-5692-4257-bc96-7f64f736695d-delete_snapshot" released by "delete_snapshot" :: held 5.696s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:35 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3dee007-4f1a-4c76-9a71-a21a6c5cc7aa" returned: 0 in 5.242s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:35 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[623bef62-3a8f-49d5-8c29-011c6d335e9c]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:35 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574 Jul 06 15:36:35 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ba86a015-c71e-49cf-a2a1-1bd8bfe8f840 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Acquiring lock "cinder-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ba86a015-c71e-49cf-a2a1-1bd8bfe8f840 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Lock "cinder-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ba86a015-c71e-49cf-a2a1-1bd8bfe8f840 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Acquiring lock "cinder-quobyte-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ba86a015-c71e-49cf-a2a1-1bd8bfe8f840 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Lock "cinder-quobyte-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721" acquired by "delete_volume" :: waited 0.022s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:36 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7a3076-09f0-46c5-bb07-ebe731191b0a]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ba86a015-c71e-49cf-a2a1-1bd8bfe8f840 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:36 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721 Jul 06 15:36:36 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:36 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574" returned: 0 in 0.943s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:36 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574, size 1024.00 MB, duration 5.24 sec, destination /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3dee007-4f1a-4c76-9a71-a21a6c5cc7aa {{(pid=86148) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:36:36 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Converted 1024.00 MB image at 195.32 MB/s Jul 06 15:36:36 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3dee007-4f1a-4c76-9a71-a21a6c5cc7aa is being set with open permissions: ugo+rw: NotImplementedError Jul 06 15:36:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3dee007-4f1a-4c76-9a71-a21a6c5cc7aa {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:36 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3dee007-4f1a-4c76-9a71-a21a6c5cc7aa Jul 06 15:36:36 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:37 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ba86a015-c71e-49cf-a2a1-1bd8bfe8f840 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721" returned: 0 in 0.923s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ba86a015-c71e-49cf-a2a1-1bd8bfe8f840 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:37 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721 Jul 06 15:36:37 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:37 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3dee007-4f1a-4c76-9a71-a21a6c5cc7aa" returned: 0 in 0.822s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:37 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-d3dee007-4f1a-4c76-9a71-a21a6c5cc7aa" released by "_copy_volume_from_snapshot" :: held 8.909s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:37 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-b94b500e-d845-4f07-a1a3-50522076907b-d3dee007-4f1a-4c76-9a71-a21a6c5cc7aa" released by "_create_volume_from_snapshot" :: held 8.947s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.987s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.400s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:37 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Acquiring lock "cinder-quobyte-4c9f30d1-0009-4e41-b6ff-41f2a20c0103-8132a75d-0fb3-4d8f-b2b2-d286de8595f9" by "_create_volume_from_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:37 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Lock "cinder-quobyte-4c9f30d1-0009-4e41-b6ff-41f2a20c0103-8132a75d-0fb3-4d8f-b2b2-d286de8595f9" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Creating volume 8132a75d-0fb3-4d8f-b2b2-d286de8595f9 from snapshot 4c9f30d1-0009-4e41-b6ff-41f2a20c0103 {{(pid=86148) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 15:36:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:36:37 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Acquiring lock "cinder-quobyte-8132a75d-0fb3-4d8f-b2b2-d286de8595f9" by "_copy_volume_from_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:37 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Lock "cinder-quobyte-8132a75d-0fb3-4d8f-b2b2-d286de8595f9" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] snapshot: 4c9f30d1-0009-4e41-b6ff-41f2a20c0103, volume: 8132a75d-0fb3-4d8f-b2b2-d286de8595f9, {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 15:36:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:37 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f6df6b-f109-4a3c-b1ae-aca438ea47cc]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.4c9f30d1-0009-4e41-b6ff-41f2a20c0103 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:37 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-fef48bb6-7d22-42f9-88f1-e5210004fb5a tempest-GroupSnapshotsTest-729188743 None] Create group from source-snapshot-25531419-d45e-4fcd-8572-6de95390d4a9 completed successfully. Jul 06 15:36:37 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.4c9f30d1-0009-4e41-b6ff-41f2a20c0103 Jul 06 15:36:37 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:38 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ba86a015-c71e-49cf-a2a1-1bd8bfe8f840 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721" returned: 0 in 0.783s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ba86a015-c71e-49cf-a2a1-1bd8bfe8f840 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Lock "cinder-quobyte-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721" released by "delete_volume" :: held 1.785s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:38 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-ba86a015-c71e-49cf-a2a1-1bd8bfe8f840 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Created reservations ['61a702be-6c20-44b1-bb12-0f6832fdc43f', '1f2a90f7-727d-42c5-852d-199efe2eaa18', '4d96b359-3b30-4f83-bb14-cfdf143de6ba', '0afe7dd3-3cae-4a5f-a8dd-9d8eb8853d6d'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:36:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ba86a015-c71e-49cf-a2a1-1bd8bfe8f840 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ba86a015-c71e-49cf-a2a1-1bd8bfe8f840 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ba86a015-c71e-49cf-a2a1-1bd8bfe8f840 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ba86a015-c71e-49cf-a2a1-1bd8bfe8f840 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ba86a015-c71e-49cf-a2a1-1bd8bfe8f840 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ba86a015-c71e-49cf-a2a1-1bd8bfe8f840 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:38 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:36:38 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:36:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:38 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:36:38 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:38 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fa61dd5c-f74d-466a-b285-a6f106e3c4f1 tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "cinder-quobyte-d3dee007-4f1a-4c76-9a71-a21a6c5cc7aa" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.4c9f30d1-0009-4e41-b6ff-41f2a20c0103" returned: 0 in 1.321s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c568390-9d78-48fe-845c-2f90ff72701b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:36:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 15:36:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Creating direct copy from snapshot {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 15:36:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fa61dd5c-f74d-466a-b285-a6f106e3c4f1 tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-d3dee007-4f1a-4c76-9a71-a21a6c5cc7aa" acquired by "delete_volume" :: waited 0.051s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:38 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c794ad-e6b9-438f-b51b-ab8cbdc5c06a]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:38 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f98df7-d152-4084-9da8-f471f3a50f99]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fa61dd5c-f74d-466a-b285-a6f106e3c4f1 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3dee007-4f1a-4c76-9a71-a21a6c5cc7aa {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:39 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b Jul 06 15:36:39 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:39 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3dee007-4f1a-4c76-9a71-a21a6c5cc7aa Jul 06 15:36:39 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:39 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.999s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:36:39 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager._thread_info {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:36:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread count: 28 {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:36:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread info: [<_MainThread(MainThread, started 124857273856128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:36:40 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ba86a015-c71e-49cf-a2a1-1bd8bfe8f840 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.724s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:40 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-ba86a015-c71e-49cf-a2a1-1bd8bfe8f840 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:36:40 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-ba86a015-c71e-49cf-a2a1-1bd8bfe8f840 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Deleted volume successfully. Jul 06 15:36:40 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ba86a015-c71e-49cf-a2a1-1bd8bfe8f840 tempest-VolumesSnapshotNegativeTestJSON-1189206974 None] Lock "cinder-b4cfb7f1-34ea-4ebc-bb93-d6b05a411721-delete_volume" released by "delete_volume" :: held 3.891s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:40 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fa61dd5c-f74d-466a-b285-a6f106e3c4f1 tempest-GroupSnapshotsTest-729188743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3dee007-4f1a-4c76-9a71-a21a6c5cc7aa" returned: 0 in 1.294s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fa61dd5c-f74d-466a-b285-a6f106e3c4f1 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3dee007-4f1a-4c76-9a71-a21a6c5cc7aa {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:40 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3dee007-4f1a-4c76-9a71-a21a6c5cc7aa Jul 06 15:36:40 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b" returned: 0 in 1.431s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:40 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:40 devstack cinder-volume[86148]: DEBUG cinder.utils [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Path /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8132a75d-0fb3-4d8f-b2b2-d286de8595f9 not found in is_blk_device check {{(pid=86148) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 15:36:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8132a75d-0fb3-4d8f-b2b2-d286de8595f9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:40 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8132a75d-0fb3-4d8f-b2b2-d286de8595f9 Jul 06 15:36:40 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:41 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fa61dd5c-f74d-466a-b285-a6f106e3c4f1 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3dee007-4f1a-4c76-9a71-a21a6c5cc7aa" returned: 0 in 1.001s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fa61dd5c-f74d-466a-b285-a6f106e3c4f1 tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-d3dee007-4f1a-4c76-9a71-a21a6c5cc7aa" released by "delete_volume" :: held 2.373s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:41 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-fa61dd5c-f74d-466a-b285-a6f106e3c4f1 tempest-GroupSnapshotsTest-729188743 None] Created reservations ['b883c4f7-460f-4fe8-9df8-f59e80ef7e57'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:36:41 devstack cinder-volume[86148]: WARNING cinder.quota [None req-fa61dd5c-f74d-466a-b285-a6f106e3c4f1 tempest-GroupSnapshotsTest-729188743 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1349524972 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1349524972, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:36:41 devstack cinder-volume[86148]: WARNING cinder.quota [None req-fa61dd5c-f74d-466a-b285-a6f106e3c4f1 tempest-GroupSnapshotsTest-729188743 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1349524972 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1349524972, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:36:41 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-fa61dd5c-f74d-466a-b285-a6f106e3c4f1 tempest-GroupSnapshotsTest-729188743 None] Created reservations ['5686a688-e7b6-4ba9-9940-57e7d2f82e51', 'acac5cac-684c-4f47-a6f3-a2d9e6164269', '0f86b1f3-dc81-4ace-8a88-5abcf713beff', 'edd0934c-757d-41d4-90bf-ad6e02addcc1'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:36:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fa61dd5c-f74d-466a-b285-a6f106e3c4f1 tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fa61dd5c-f74d-466a-b285-a6f106e3c4f1 tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:41 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fa61dd5c-f74d-466a-b285-a6f106e3c4f1 tempest-GroupSnapshotsTest-729188743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:41 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fa61dd5c-f74d-466a-b285-a6f106e3c4f1 tempest-GroupSnapshotsTest-729188743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fa61dd5c-f74d-466a-b285-a6f106e3c4f1 tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fa61dd5c-f74d-466a-b285-a6f106e3c4f1 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:41 devstack sudo[98103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:36:41 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:43 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-ff6e819d-aff6-40af-b2f3-629051e917e4 tempest-GroupSnapshotsTest-729188743 None] group_snapshot 25531419-d45e-4fcd-8572-6de95390d4a9: deleting Jul 06 15:36:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ff6e819d-aff6-40af-b2f3-629051e917e4 tempest-GroupSnapshotsTest-729188743 None] group_snapshot 25531419-d45e-4fcd-8572-6de95390d4a9: deleting {{(pid=86148) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 15:36:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ff6e819d-aff6-40af-b2f3-629051e917e4 tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "cinder-quobyte-8da86705-bcf6-40bc-8053-3c6b7ebf4574" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ff6e819d-aff6-40af-b2f3-629051e917e4 tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-8da86705-bcf6-40bc-8053-3c6b7ebf4574" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ff6e819d-aff6-40af-b2f3-629051e917e4 tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "cinder-quobyte-b94b500e-d845-4f07-a1a3-50522076907b" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ff6e819d-aff6-40af-b2f3-629051e917e4 tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-b94b500e-d845-4f07-a1a3-50522076907b" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:43 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-ff6e819d-aff6-40af-b2f3-629051e917e4 tempest-GroupSnapshotsTest-729188743 None] Deleting offline snapshot b94b500e-d845-4f07-a1a3-50522076907b of volume 8da86705-bcf6-40bc-8053-3c6b7ebf4574 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:36:43 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-ff6e819d-aff6-40af-b2f3-629051e917e4 tempest-GroupSnapshotsTest-729188743 None] snapshot_file for this snap is: volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.b94b500e-d845-4f07-a1a3-50522076907b {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:36:43 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[967fe6d7-7fdd-46b3-a965-e2e290edf720]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff6e819d-aff6-40af-b2f3-629051e917e4 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.b94b500e-d845-4f07-a1a3-50522076907b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:43 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.b94b500e-d845-4f07-a1a3-50522076907b Jul 06 15:36:43 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:43 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fa61dd5c-f74d-466a-b285-a6f106e3c4f1 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 2.045s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:43 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-fa61dd5c-f74d-466a-b285-a6f106e3c4f1 tempest-GroupSnapshotsTest-729188743 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:36:43 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-fa61dd5c-f74d-466a-b285-a6f106e3c4f1 tempest-GroupSnapshotsTest-729188743 None] Delete group completed successfully. Jul 06 15:36:45 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff6e819d-aff6-40af-b2f3-629051e917e4 tempest-GroupSnapshotsTest-729188743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.b94b500e-d845-4f07-a1a3-50522076907b" returned: 0 in 2.236s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-ff6e819d-aff6-40af-b2f3-629051e917e4 tempest-GroupSnapshotsTest-729188743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:36:45 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cda2d1f-2c24-4676-a9e6-82f9405608e1]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff6e819d-aff6-40af-b2f3-629051e917e4 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:45 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574 Jul 06 15:36:45 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:47 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff6e819d-aff6-40af-b2f3-629051e917e4 tempest-GroupSnapshotsTest-729188743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574" returned: 0 in 2.092s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff6e819d-aff6-40af-b2f3-629051e917e4 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.b94b500e-d845-4f07-a1a3-50522076907b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:47 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.b94b500e-d845-4f07-a1a3-50522076907b Jul 06 15:36:47 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:48 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8132a75d-0fb3-4d8f-b2b2-d286de8595f9" returned: 0 in 8.126s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:48 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eff3c61-f11b-4c33-8738-ae2a6f4c077e]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:48 devstack sudo[98168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b Jul 06 15:36:48 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:49 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff6e819d-aff6-40af-b2f3-629051e917e4 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.b94b500e-d845-4f07-a1a3-50522076907b" returned: 0 in 1.413s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff6e819d-aff6-40af-b2f3-629051e917e4 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.b94b500e-d845-4f07-a1a3-50522076907b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:49 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.b94b500e-d845-4f07-a1a3-50522076907b Jul 06 15:36:49 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:49 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b" returned: 0 in 1.439s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:49 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b, size 1024.00 MB, duration 8.13 sec, destination /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8132a75d-0fb3-4d8f-b2b2-d286de8595f9 {{(pid=86148) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:36:49 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Converted 1024.00 MB image at 126.00 MB/s Jul 06 15:36:49 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8132a75d-0fb3-4d8f-b2b2-d286de8595f9 is being set with open permissions: ugo+rw Jul 06 15:36:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8132a75d-0fb3-4d8f-b2b2-d286de8595f9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:50 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8132a75d-0fb3-4d8f-b2b2-d286de8595f9 Jul 06 15:36:50 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:50 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff6e819d-aff6-40af-b2f3-629051e917e4 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574.b94b500e-d845-4f07-a1a3-50522076907b" returned: 0 in 1.180s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:50 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ff6e819d-aff6-40af-b2f3-629051e917e4 tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-b94b500e-d845-4f07-a1a3-50522076907b" released by "_delete_snapshot" :: held 7.174s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:50 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ff6e819d-aff6-40af-b2f3-629051e917e4 tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-8da86705-bcf6-40bc-8053-3c6b7ebf4574" released by "delete_snapshot" :: held 7.239s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:50 devstack cinder-volume[86148]: WARNING cinder.quota [None req-ff6e819d-aff6-40af-b2f3-629051e917e4 tempest-GroupSnapshotsTest-729188743 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1349524972 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1349524972, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:36:50 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-ff6e819d-aff6-40af-b2f3-629051e917e4 tempest-GroupSnapshotsTest-729188743 None] Created reservations ['4320988f-b158-4799-ac51-79a2dfc9751c', '5aaeca76-03c3-434c-be6f-48ac1afb0169', '6e638da4-20f0-4fa6-9ea5-2b34889cd2df', 'dd88c33e-c473-4a63-bbc1-b73727ac5003'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:36:50 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-ff6e819d-aff6-40af-b2f3-629051e917e4 tempest-GroupSnapshotsTest-729188743 None] group_snapshot 25531419-d45e-4fcd-8572-6de95390d4a9: deleted successfully Jul 06 15:36:51 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8132a75d-0fb3-4d8f-b2b2-d286de8595f9" returned: 0 in 1.080s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:51 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Lock "cinder-quobyte-8132a75d-0fb3-4d8f-b2b2-d286de8595f9" released by "_copy_volume_from_snapshot" :: held 13.588s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:51 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Lock "cinder-quobyte-4c9f30d1-0009-4e41-b6ff-41f2a20c0103-8132a75d-0fb3-4d8f-b2b2-d286de8595f9" released by "_create_volume_from_snapshot" :: held 13.632s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.659s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.362s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-631044312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da52aa0-ca1e-4008-89e8-3cd1395743f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f03cc8bb0a4c129bd396fa32f11012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:29Z,use_quota=True,user_id='7fa98b98610344dea1bf7cf30b9dc06f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:36:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Creating volume 0da52aa0-ca1e-4008-89e8-3cd1395743f2 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:36:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:36:51 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:36:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:51 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2 1073741824 Jul 06 15:36:51 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4ed6115-4acd-402d-9774-887c59a4fd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8132a75d-0fb3-4d8f-b2b2-d286de8595f9', 'volume_size': 1, 'snapshot_id': '4c9f30d1-0009-4e41-b6ff-41f2a20c0103'}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac33d471-b0da-4d47-b725-dd857b7c7612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:51 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Volume volume-8132a75d-0fb3-4d8f-b2b2-d286de8595f9 (8132a75d-0fb3-4d8f-b2b2-d286de8595f9): created successfully Jul 06 15:36:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac33d471-b0da-4d47-b725-dd857b7c7612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Flow 'volume_create_manager' (7e5b75d7-7372-41dc-8598-acf963edb53d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:36:51 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-62e3de0a-71e2-4e69-bb47-7eb54902b35e tempest-TestStampPattern-150571277 None] Created volume successfully. Jul 06 15:36:51 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-02e92d48-d386-4fa2-8444-03dacb0e3e4d tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "cinder-quobyte-8da86705-bcf6-40bc-8053-3c6b7ebf4574" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:52 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-02e92d48-d386-4fa2-8444-03dacb0e3e4d tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-8da86705-bcf6-40bc-8053-3c6b7ebf4574" acquired by "delete_volume" :: waited 0.033s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:52 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f33b6ae-4fe9-46f1-9c37-4259215f7580]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-02e92d48-d386-4fa2-8444-03dacb0e3e4d tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:52 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574 Jul 06 15:36:52 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:52 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2 1073741824" returned: 0 in 1.641s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:52 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2 Jul 06 15:36:52 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:53 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-02e92d48-d386-4fa2-8444-03dacb0e3e4d tempest-GroupSnapshotsTest-729188743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574" returned: 0 in 1.550s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-02e92d48-d386-4fa2-8444-03dacb0e3e4d tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:53 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574 Jul 06 15:36:53 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:53 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2" returned: 0 in 1.086s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:53 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] <== create_volume: return (2825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:36:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.831s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b754863b-d09d-4dc8-b2a5-4f89cb79db58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9dbe72e-b852-4302-8660-f2e5c0978cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:54 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Volume volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2 (0da52aa0-ca1e-4008-89e8-3cd1395743f2): created successfully Jul 06 15:36:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9dbe72e-b852-4302-8660-f2e5c0978cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Flow 'volume_create_manager' (21b9016c-7a6b-4917-a18b-e4dbe0cb3da6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:36:54 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-169d8186-8225-4b4a-a228-b1d131b767a1 tempest-VolumesSnapshotListTestJSON-1154159094 None] Created volume successfully. Jul 06 15:36:54 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-02e92d48-d386-4fa2-8444-03dacb0e3e4d tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8da86705-bcf6-40bc-8053-3c6b7ebf4574" returned: 0 in 1.242s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-02e92d48-d386-4fa2-8444-03dacb0e3e4d tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-8da86705-bcf6-40bc-8053-3c6b7ebf4574" released by "delete_volume" :: held 2.951s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d461f533-6b86-4608-8f1b-ae0862dd57ad tempest-VolumesSnapshotListTestJSON-1154159094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d461f533-6b86-4608-8f1b-ae0862dd57ad tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:55 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-d461f533-6b86-4608-8f1b-ae0862dd57ad tempest-VolumesSnapshotListTestJSON-1154159094 None] Creating offline snapshot f4a894f6-8e41-4614-9303-0ff4f6b61508 of volume 0da52aa0-ca1e-4008-89e8-3cd1395743f2 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:36:55 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-02e92d48-d386-4fa2-8444-03dacb0e3e4d tempest-GroupSnapshotsTest-729188743 None] Created reservations ['459dbd8b-ab42-4a2a-a371-87ad51ca2ee5'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:36:55 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbcca9a-88b9-4b3d-adf2-9f6ca683fa99]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d461f533-6b86-4608-8f1b-ae0862dd57ad tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:55 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2 Jul 06 15:36:55 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:55 devstack cinder-volume[86148]: WARNING cinder.db.api [None req-02e92d48-d386-4fa2-8444-03dacb0e3e4d tempest-GroupSnapshotsTest-729188743 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1349524972'] Jul 06 15:36:55 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-02e92d48-d386-4fa2-8444-03dacb0e3e4d tempest-GroupSnapshotsTest-729188743 None] Created reservations ['bc4a61cc-a836-4c68-97a9-901e5e162a02', '28a91b23-60c5-4964-a95e-c7410007d28c', 'af4562e5-959b-4b1d-b710-b830d1293058', 'c57b96ed-44f9-4986-b668-a73700692848'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:36:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-02e92d48-d386-4fa2-8444-03dacb0e3e4d tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-02e92d48-d386-4fa2-8444-03dacb0e3e4d tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:55 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-02e92d48-d386-4fa2-8444-03dacb0e3e4d tempest-GroupSnapshotsTest-729188743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:55 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-02e92d48-d386-4fa2-8444-03dacb0e3e4d tempest-GroupSnapshotsTest-729188743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-02e92d48-d386-4fa2-8444-03dacb0e3e4d tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-02e92d48-d386-4fa2-8444-03dacb0e3e4d tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:55 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:36:55 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:56 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-ccfe7aea-4cb0-4104-bbce-91f70f5887a7 tempest-GroupSnapshotsTest-729188743 None] Group tempest-GroupSnapshotsTest-Group-1535472785: creating Jul 06 15:36:56 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-ccfe7aea-4cb0-4104-bbce-91f70f5887a7 tempest-GroupSnapshotsTest-729188743 None] Group tempest-GroupSnapshotsTest-Group-1535472785: created successfully Jul 06 15:36:56 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-ccfe7aea-4cb0-4104-bbce-91f70f5887a7 tempest-GroupSnapshotsTest-729188743 None] Create group completed successfully. Jul 06 15:36:56 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d461f533-6b86-4608-8f1b-ae0862dd57ad tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2" returned: 0 in 1.684s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d461f533-6b86-4608-8f1b-ae0862dd57ad tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:57 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508 1G Jul 06 15:36:57 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:57 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-02e92d48-d386-4fa2-8444-03dacb0e3e4d tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.541s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:57 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-02e92d48-d386-4fa2-8444-03dacb0e3e4d tempest-GroupSnapshotsTest-729188743 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:36:57 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-02e92d48-d386-4fa2-8444-03dacb0e3e4d tempest-GroupSnapshotsTest-729188743 None] Delete group completed successfully. Jul 06 15:36:58 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d461f533-6b86-4608-8f1b-ae0862dd57ad tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508 1G" returned: 0 in 1.492s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d461f533-6b86-4608-8f1b-ae0862dd57ad tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:58 devstack sudo[98237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508 Jul 06 15:36:58 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:59 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:36:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Flow 'volume_create_manager' (07a1540f-70f6-48c2-bf5e-629aabac2c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:36:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc90016-9417-4e76-a39f-09723d7f07bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc90016-9417-4e76-a39f-09723d7f07bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-344115750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3773a5b4-c381-40da-8f8c-1aa28a83e6a8,host='devstack@QuobyteHD#QuobyteHD',id=9b5d2b24-3f3a-46c9-b96b-6c42c0103f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a2e8e36e05845e6b70b3678e743370c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:59Z,use_quota=True,user_id='cd3548cd12eb48df879c2b63da879e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(003d4446-c2f6-48d4-853a-ae29f3d6c931),volume_type_id=003d4446-c2f6-48d4-853a-ae29f3d6c931)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0a73f2-d71e-4265-b95a-e0ac320770f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0a73f2-d71e-4265-b95a-e0ac320770f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ece806-3573-4b95-8815-d0e10efb836c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ece806-3573-4b95-8815-d0e10efb836c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b5d2b24-3f3a-46c9-b96b-6c42c0103f05', 'volume_name': 'volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d183a423-cc59-4500-a912-406228e4466a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d183a423-cc59-4500-a912-406228e4466a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ead2d7-1ac5-45de-bf82-ddd5ee22cb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:59 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Volume 9b5d2b24-3f3a-46c9-b96b-6c42c0103f05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05', 'volume_size': 1} Jul 06 15:36:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:59 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d461f533-6b86-4608-8f1b-ae0862dd57ad tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508" returned: 0 in 1.514s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:59 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-d461f533-6b86-4608-8f1b-ae0862dd57ad tempest-VolumesSnapshotListTestJSON-1154159094 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508 is being set with open permissions: ugo+rw Jul 06 15:36:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d461f533-6b86-4608-8f1b-ae0862dd57ad tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:59 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508 Jul 06 15:36:59 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:00 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d461f533-6b86-4608-8f1b-ae0862dd57ad tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508" returned: 0 in 0.968s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d461f533-6b86-4608-8f1b-ae0862dd57ad tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:00 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.info Jul 06 15:37:01 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:01 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d461f533-6b86-4608-8f1b-ae0862dd57ad tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.info" returned: 0 in 0.667s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:01 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-d461f533-6b86-4608-8f1b-ae0862dd57ad tempest-VolumesSnapshotListTestJSON-1154159094 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.info is being set with open permissions: ugo+rw Jul 06 15:37:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d461f533-6b86-4608-8f1b-ae0862dd57ad tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:01 devstack sudo[98270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.info Jul 06 15:37:01 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:02 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d461f533-6b86-4608-8f1b-ae0862dd57ad tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.info" returned: 0 in 0.677s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d461f533-6b86-4608-8f1b-ae0862dd57ad tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.202s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.173s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:02 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3773a5b4-c381-40da-8f8c-1aa28a83e6a8,created_at=2026-07-06T13:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-344115750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3773a5b4-c381-40da-8f8c-1aa28a83e6a8,host='devstack@QuobyteHD#QuobyteHD',id=9b5d2b24-3f3a-46c9-b96b-6c42c0103f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a2e8e36e05845e6b70b3678e743370c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:59Z,use_quota=True,user_id='cd3548cd12eb48df879c2b63da879e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(003d4446-c2f6-48d4-853a-ae29f3d6c931),volume_type_id=003d4446-c2f6-48d4-853a-ae29f3d6c931)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:37:02 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Creating volume 9b5d2b24-3f3a-46c9-b96b-6c42c0103f05 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:37:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:02 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:37:02 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:37:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:02 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:37:02 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:37:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:02 devstack sudo[98273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05 1073741824 Jul 06 15:37:02 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:02 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-d461f533-6b86-4608-8f1b-ae0862dd57ad tempest-VolumesSnapshotListTestJSON-1154159094 None] Create snapshot completed successfully Jul 06 15:37:03 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05 1073741824" returned: 0 in 0.954s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:03 devstack sudo[98278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05 Jul 06 15:37:03 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9fecaab9-49c2-43a3-a1f2-df4266bc4bfa tempest-VolumesSnapshotListTestJSON-1154159094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:04 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05" returned: 0 in 0.732s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:04 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:37:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9fecaab9-49c2-43a3-a1f2-df4266bc4bfa tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.443s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:04 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-9fecaab9-49c2-43a3-a1f2-df4266bc4bfa tempest-VolumesSnapshotListTestJSON-1154159094 None] Creating offline snapshot 3d57516a-e9e3-4c5f-b6b5-0b640507382b of volume 0da52aa0-ca1e-4008-89e8-3cd1395743f2 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:37:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ead2d7-1ac5-45de-bf82-ddd5ee22cb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8910f2ce-72f2-47f3-987c-c593328a820a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:04 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Volume volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05 (9b5d2b24-3f3a-46c9-b96b-6c42c0103f05): created successfully Jul 06 15:37:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8910f2ce-72f2-47f3-987c-c593328a820a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Flow 'volume_create_manager' (07a1540f-70f6-48c2-bf5e-629aabac2c8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:37:04 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[263447e9-2df9-40e3-9bc4-baab877935ff]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9fecaab9-49c2-43a3-a1f2-df4266bc4bfa tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:04 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-4809e45c-d9e6-4928-9e91-569c8d8bc55a tempest-GroupSnapshotsTest-729188743 None] Created volume successfully. Jul 06 15:37:04 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508 Jul 06 15:37:04 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:05 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9fecaab9-49c2-43a3-a1f2-df4266bc4bfa tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508" returned: 0 in 0.878s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:05 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-9fecaab9-49c2-43a3-a1f2-df4266bc4bfa tempest-VolumesSnapshotListTestJSON-1154159094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:37:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9fecaab9-49c2-43a3-a1f2-df4266bc4bfa tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:05 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b 1G Jul 06 15:37:05 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:05 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:37:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Flow 'volume_create_manager' (1691cae5-1c9e-45bd-99ed-f1958db881ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:37:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89616595-f814-40ce-acc1-370acdec1de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89616595-f814-40ce-acc1-370acdec1de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-680276267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3773a5b4-c381-40da-8f8c-1aa28a83e6a8,host='devstack@QuobyteHD#QuobyteHD',id=f2985ca0-c420-44ff-9cf9-aee476e4fe63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a2e8e36e05845e6b70b3678e743370c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:06Z,use_quota=True,user_id='cd3548cd12eb48df879c2b63da879e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(003d4446-c2f6-48d4-853a-ae29f3d6c931),volume_type_id=003d4446-c2f6-48d4-853a-ae29f3d6c931)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1716c22c-5b67-4650-93a1-d92ef63e9901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1716c22c-5b67-4650-93a1-d92ef63e9901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (478fa5b6-17c4-4709-a171-1c5af425c676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (478fa5b6-17c4-4709-a171-1c5af425c676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2985ca0-c420-44ff-9cf9-aee476e4fe63', 'volume_name': 'volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2837a615-3594-4b49-9bf4-97afabd9cd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2837a615-3594-4b49-9bf4-97afabd9cd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7849a94-5e7c-4452-bad1-5d4c51ff0c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:05 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Volume f2985ca0-c420-44ff-9cf9-aee476e4fe63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63', 'volume_size': 1} Jul 06 15:37:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:06 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9fecaab9-49c2-43a3-a1f2-df4266bc4bfa tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b 1G" returned: 0 in 0.940s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9fecaab9-49c2-43a3-a1f2-df4266bc4bfa tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:06 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b Jul 06 15:37:06 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:06 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9fecaab9-49c2-43a3-a1f2-df4266bc4bfa tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b" returned: 0 in 0.855s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:06 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-9fecaab9-49c2-43a3-a1f2-df4266bc4bfa tempest-VolumesSnapshotListTestJSON-1154159094 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b is being set with open permissions: ugo+rw Jul 06 15:37:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9fecaab9-49c2-43a3-a1f2-df4266bc4bfa tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:06 devstack sudo[98298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b Jul 06 15:37:06 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:07 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9fecaab9-49c2-43a3-a1f2-df4266bc4bfa tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b" returned: 0 in 0.731s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9fecaab9-49c2-43a3-a1f2-df4266bc4bfa tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.544s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.854s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3773a5b4-c381-40da-8f8c-1aa28a83e6a8,created_at=2026-07-06T13:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-680276267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3773a5b4-c381-40da-8f8c-1aa28a83e6a8,host='devstack@QuobyteHD#QuobyteHD',id=f2985ca0-c420-44ff-9cf9-aee476e4fe63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a2e8e36e05845e6b70b3678e743370c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:06Z,use_quota=True,user_id='cd3548cd12eb48df879c2b63da879e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(003d4446-c2f6-48d4-853a-ae29f3d6c931),volume_type_id=003d4446-c2f6-48d4-853a-ae29f3d6c931)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:37:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Creating volume f2985ca0-c420-44ff-9cf9-aee476e4fe63 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:37:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:37:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:37:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:37:07 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:37:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:07 devstack sudo[98302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63 1073741824 Jul 06 15:37:07 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:07 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-9fecaab9-49c2-43a3-a1f2-df4266bc4bfa tempest-VolumesSnapshotListTestJSON-1154159094 None] Create snapshot completed successfully Jul 06 15:37:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c77c8579-4a2f-43ac-bf55-1ae14ca72b3d tempest-VolumesSnapshotListTestJSON-1154159094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:08 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63 1073741824" returned: 0 in 0.990s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:08 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63 Jul 06 15:37:08 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:09 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63" returned: 0 in 0.690s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:37:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c77c8579-4a2f-43ac-bf55-1ae14ca72b3d tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.257s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7849a94-5e7c-4452-bad1-5d4c51ff0c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dbca8bc-010f-4fd4-872b-6d434d37f51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-c77c8579-4a2f-43ac-bf55-1ae14ca72b3d tempest-VolumesSnapshotListTestJSON-1154159094 None] Creating offline snapshot 3616b109-69b2-4b87-bc5a-1161969156e9 of volume 0da52aa0-ca1e-4008-89e8-3cd1395743f2 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:37:09 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Volume volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63 (f2985ca0-c420-44ff-9cf9-aee476e4fe63): created successfully Jul 06 15:37:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dbca8bc-010f-4fd4-872b-6d434d37f51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Flow 'volume_create_manager' (1691cae5-1c9e-45bd-99ed-f1958db881ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:37:09 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ec7286-c1be-4ac4-a539-64e187db2690]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c77c8579-4a2f-43ac-bf55-1ae14ca72b3d tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:09 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-bc8b6c01-5669-42ab-80d6-66d3b8da3d7a tempest-GroupSnapshotsTest-729188743 None] Created volume successfully. Jul 06 15:37:09 devstack sudo[98312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b Jul 06 15:37:09 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:10 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c77c8579-4a2f-43ac-bf55-1ae14ca72b3d tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b" returned: 0 in 0.804s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:10 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-c77c8579-4a2f-43ac-bf55-1ae14ca72b3d tempest-VolumesSnapshotListTestJSON-1154159094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:37:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c77c8579-4a2f-43ac-bf55-1ae14ca72b3d tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3616b109-69b2-4b87-bc5a-1161969156e9 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:10 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3616b109-69b2-4b87-bc5a-1161969156e9 1G Jul 06 15:37:10 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:10 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-c37ddbbd-4f67-42db-b5a7-0356e181a2ec tempest-GroupSnapshotsTest-729188743 None] Update group completed successfully. Jul 06 15:37:11 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c77c8579-4a2f-43ac-bf55-1ae14ca72b3d tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3616b109-69b2-4b87-bc5a-1161969156e9 1G" returned: 0 in 1.083s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c77c8579-4a2f-43ac-bf55-1ae14ca72b3d tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3616b109-69b2-4b87-bc5a-1161969156e9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:11 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3616b109-69b2-4b87-bc5a-1161969156e9 Jul 06 15:37:11 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:12 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-75758823-6ef2-4ad9-a249-6012c7007725 tempest-GroupSnapshotsTest-729188743 None] Update group completed successfully. Jul 06 15:37:12 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c77c8579-4a2f-43ac-bf55-1ae14ca72b3d tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3616b109-69b2-4b87-bc5a-1161969156e9" returned: 0 in 0.815s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:12 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-c77c8579-4a2f-43ac-bf55-1ae14ca72b3d tempest-VolumesSnapshotListTestJSON-1154159094 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3616b109-69b2-4b87-bc5a-1161969156e9 is being set with open permissions: ugo+rw Jul 06 15:37:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c77c8579-4a2f-43ac-bf55-1ae14ca72b3d tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3616b109-69b2-4b87-bc5a-1161969156e9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:12 devstack sudo[98329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3616b109-69b2-4b87-bc5a-1161969156e9 Jul 06 15:37:12 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:12 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c77c8579-4a2f-43ac-bf55-1ae14ca72b3d tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3616b109-69b2-4b87-bc5a-1161969156e9" returned: 0 in 0.670s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c77c8579-4a2f-43ac-bf55-1ae14ca72b3d tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.541s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:12 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-c77c8579-4a2f-43ac-bf55-1ae14ca72b3d tempest-VolumesSnapshotListTestJSON-1154159094 None] Create snapshot completed successfully Jul 06 15:37:13 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-ccb8b6d0-c7c2-402e-95dd-5397abbc7383 tempest-GroupSnapshotsTest-729188743 None] Update group completed successfully. Jul 06 15:37:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c46b68d1-f8ee-4928-b609-86dc25d32daa tempest-VolumesSnapshotListTestJSON-1154159094 None] Acquiring lock "cinder-3616b109-69b2-4b87-bc5a-1161969156e9-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c46b68d1-f8ee-4928-b609-86dc25d32daa tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "cinder-3616b109-69b2-4b87-bc5a-1161969156e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c46b68d1-f8ee-4928-b609-86dc25d32daa tempest-VolumesSnapshotListTestJSON-1154159094 None] Acquiring lock "cinder-quobyte-0da52aa0-ca1e-4008-89e8-3cd1395743f2" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c46b68d1-f8ee-4928-b609-86dc25d32daa tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "cinder-quobyte-0da52aa0-ca1e-4008-89e8-3cd1395743f2" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c46b68d1-f8ee-4928-b609-86dc25d32daa tempest-VolumesSnapshotListTestJSON-1154159094 None] Acquiring lock "cinder-quobyte-3616b109-69b2-4b87-bc5a-1161969156e9" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c46b68d1-f8ee-4928-b609-86dc25d32daa tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "cinder-quobyte-3616b109-69b2-4b87-bc5a-1161969156e9" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-c46b68d1-f8ee-4928-b609-86dc25d32daa tempest-VolumesSnapshotListTestJSON-1154159094 None] Deleting offline snapshot 3616b109-69b2-4b87-bc5a-1161969156e9 of volume 0da52aa0-ca1e-4008-89e8-3cd1395743f2 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:37:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-c46b68d1-f8ee-4928-b609-86dc25d32daa tempest-VolumesSnapshotListTestJSON-1154159094 None] snapshot_file for this snap is: volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3616b109-69b2-4b87-bc5a-1161969156e9 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:37:14 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[682b36e1-7ed1-4a61-8544-45333284c803]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c46b68d1-f8ee-4928-b609-86dc25d32daa tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3616b109-69b2-4b87-bc5a-1161969156e9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:14 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3616b109-69b2-4b87-bc5a-1161969156e9 Jul 06 15:37:14 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-4fdf7052-c303-4673-bdc9-87bcf065109e tempest-GroupSnapshotsTest-729188743 None] Update group completed successfully. Jul 06 15:37:14 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:15 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c46b68d1-f8ee-4928-b609-86dc25d32daa tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3616b109-69b2-4b87-bc5a-1161969156e9" returned: 0 in 0.801s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:15 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-c46b68d1-f8ee-4928-b609-86dc25d32daa tempest-VolumesSnapshotListTestJSON-1154159094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:37:15 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2a7658-3448-4625-b661-60458ec1fe41]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c46b68d1-f8ee-4928-b609-86dc25d32daa tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:15 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b Jul 06 15:37:15 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:16 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] GroupSnapshot bc66d479-fdb3-4043-a555-cfb17f5db939: creating. Jul 06 15:37:16 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c46b68d1-f8ee-4928-b609-86dc25d32daa tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b" returned: 0 in 0.864s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:16 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-c46b68d1-f8ee-4928-b609-86dc25d32daa tempest-VolumesSnapshotListTestJSON-1154159094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:37:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c46b68d1-f8ee-4928-b609-86dc25d32daa tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3616b109-69b2-4b87-bc5a-1161969156e9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] Group snapshot bc66d479-fdb3-4043-a555-cfb17f5db939: creating. {{(pid=86148) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 15:37:16 devstack sudo[98352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3616b109-69b2-4b87-bc5a-1161969156e9 Jul 06 15:37:16 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:16 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] Creating offline snapshot 4971978c-6e9c-437e-a485-bec7eb5f8773 of volume 9b5d2b24-3f3a-46c9-b96b-6c42c0103f05 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:37:16 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[597f07ae-8353-43ba-a5c3-408d568f60e0]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:16 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05 Jul 06 15:37:16 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:16 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c46b68d1-f8ee-4928-b609-86dc25d32daa tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3616b109-69b2-4b87-bc5a-1161969156e9" returned: 0 in 0.858s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c46b68d1-f8ee-4928-b609-86dc25d32daa tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3616b109-69b2-4b87-bc5a-1161969156e9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:16 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:16 devstack sudo[98363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3616b109-69b2-4b87-bc5a-1161969156e9 Jul 06 15:37:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05" returned: 0 in 0.833s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05.4971978c-6e9c-437e-a485-bec7eb5f8773 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:16 devstack sudo[98363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:16 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05.4971978c-6e9c-437e-a485-bec7eb5f8773 1G Jul 06 15:37:16 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:17 devstack sudo[98363]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c46b68d1-f8ee-4928-b609-86dc25d32daa tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3616b109-69b2-4b87-bc5a-1161969156e9" returned: 0 in 0.737s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:17 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c46b68d1-f8ee-4928-b609-86dc25d32daa tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "cinder-quobyte-3616b109-69b2-4b87-bc5a-1161969156e9" released by "_delete_snapshot" :: held 3.367s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:17 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c46b68d1-f8ee-4928-b609-86dc25d32daa tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "cinder-quobyte-0da52aa0-ca1e-4008-89e8-3cd1395743f2" released by "delete_snapshot" :: held 3.398s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:17 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-c46b68d1-f8ee-4928-b609-86dc25d32daa tempest-VolumesSnapshotListTestJSON-1154159094 None] Created reservations ['114970e5-690f-4df1-aed3-5279c731e4e7', 'cfd031f2-c65f-4036-96a6-320bc9d13827', '6a38f53b-8249-414b-94a2-b303afca8f21', 'f29639df-3b88-4e77-aee5-773f3716e757'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:37:17 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-c46b68d1-f8ee-4928-b609-86dc25d32daa tempest-VolumesSnapshotListTestJSON-1154159094 None] Delete snapshot completed successfully. Jul 06 15:37:17 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c46b68d1-f8ee-4928-b609-86dc25d32daa tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "cinder-3616b109-69b2-4b87-bc5a-1161969156e9-delete_snapshot" released by "delete_snapshot" :: held 3.544s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:17 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05.4971978c-6e9c-437e-a485-bec7eb5f8773 1G" returned: 0 in 0.934s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05.4971978c-6e9c-437e-a485-bec7eb5f8773 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:17 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05.4971978c-6e9c-437e-a485-bec7eb5f8773 Jul 06 15:37:17 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-59adfddf-06b8-4df8-af54-5a57d58d1122 req-621c13ba-e602-4988-b0c0-d528f5d1ccdd tempest-TestStampPattern-150571277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:18 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e8b9e909-5423-4546-961c-96f1dc0a17dd tempest-VolumesSnapshotListTestJSON-1154159094 None] Acquiring lock "cinder-3d57516a-e9e3-4c5f-b6b5-0b640507382b-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:18 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e8b9e909-5423-4546-961c-96f1dc0a17dd tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "cinder-3d57516a-e9e3-4c5f-b6b5-0b640507382b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:18 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e8b9e909-5423-4546-961c-96f1dc0a17dd tempest-VolumesSnapshotListTestJSON-1154159094 None] Acquiring lock "cinder-quobyte-0da52aa0-ca1e-4008-89e8-3cd1395743f2" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:18 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e8b9e909-5423-4546-961c-96f1dc0a17dd tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "cinder-quobyte-0da52aa0-ca1e-4008-89e8-3cd1395743f2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:18 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e8b9e909-5423-4546-961c-96f1dc0a17dd tempest-VolumesSnapshotListTestJSON-1154159094 None] Acquiring lock "cinder-quobyte-3d57516a-e9e3-4c5f-b6b5-0b640507382b" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:18 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e8b9e909-5423-4546-961c-96f1dc0a17dd tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "cinder-quobyte-3d57516a-e9e3-4c5f-b6b5-0b640507382b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:18 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-e8b9e909-5423-4546-961c-96f1dc0a17dd tempest-VolumesSnapshotListTestJSON-1154159094 None] Deleting offline snapshot 3d57516a-e9e3-4c5f-b6b5-0b640507382b of volume 0da52aa0-ca1e-4008-89e8-3cd1395743f2 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:37:18 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:18 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-e8b9e909-5423-4546-961c-96f1dc0a17dd tempest-VolumesSnapshotListTestJSON-1154159094 None] snapshot_file for this snap is: volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:37:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05.4971978c-6e9c-437e-a485-bec7eb5f8773" returned: 0 in 0.700s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:18 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05.4971978c-6e9c-437e-a485-bec7eb5f8773 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 15:37:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05.4971978c-6e9c-437e-a485-bec7eb5f8773 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:18 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd933c49-ffe6-4dbe-ae54-30a1a56af335]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e8b9e909-5423-4546-961c-96f1dc0a17dd tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:18 devstack sudo[98384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05.4971978c-6e9c-437e-a485-bec7eb5f8773 Jul 06 15:37:18 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:18 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b Jul 06 15:37:18 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:19 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05.4971978c-6e9c-437e-a485-bec7eb5f8773" returned: 0 in 0.682s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:19 devstack sudo[98393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05.info Jul 06 15:37:19 devstack sudo[98393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:19 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e8b9e909-5423-4546-961c-96f1dc0a17dd tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b" returned: 0 in 0.775s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:19 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-e8b9e909-5423-4546-961c-96f1dc0a17dd tempest-VolumesSnapshotListTestJSON-1154159094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:37:19 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd835a3-b7ab-45e0-89df-1106716a77ee]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e8b9e909-5423-4546-961c-96f1dc0a17dd tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:19 devstack sudo[98395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508 Jul 06 15:37:19 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:20 devstack sudo[98393]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05.info" returned: 0 in 0.730s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:20 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 15:37:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:20 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05.info Jul 06 15:37:20 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:20 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e8b9e909-5423-4546-961c-96f1dc0a17dd tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508" returned: 0 in 0.819s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-e8b9e909-5423-4546-961c-96f1dc0a17dd tempest-VolumesSnapshotListTestJSON-1154159094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:37:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e8b9e909-5423-4546-961c-96f1dc0a17dd tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:20 devstack sudo[98403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b Jul 06 15:37:20 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:20 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05.info" returned: 0 in 0.805s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.786s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] Creating offline snapshot fad7f9d6-ebd4-4454-bea0-81262e487927 of volume f2985ca0-c420-44ff-9cf9-aee476e4fe63 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:37:20 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[0032b84c-cc65-459d-bf43-3fdb11a064ad]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:21 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63 Jul 06 15:37:21 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:21 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e8b9e909-5423-4546-961c-96f1dc0a17dd tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b" returned: 0 in 0.959s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e8b9e909-5423-4546-961c-96f1dc0a17dd tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:21 devstack sudo[98412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b Jul 06 15:37:21 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:21 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63" returned: 0 in 0.986s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63.fad7f9d6-ebd4-4454-bea0-81262e487927 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:21 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e8b9e909-5423-4546-961c-96f1dc0a17dd tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.3d57516a-e9e3-4c5f-b6b5-0b640507382b" returned: 0 in 0.751s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:21 devstack sudo[98418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63.fad7f9d6-ebd4-4454-bea0-81262e487927 1G Jul 06 15:37:21 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:22 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e8b9e909-5423-4546-961c-96f1dc0a17dd tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "cinder-quobyte-3d57516a-e9e3-4c5f-b6b5-0b640507382b" released by "_delete_snapshot" :: held 3.454s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:22 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e8b9e909-5423-4546-961c-96f1dc0a17dd tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "cinder-quobyte-0da52aa0-ca1e-4008-89e8-3cd1395743f2" released by "delete_snapshot" :: held 3.490s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:22 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-e8b9e909-5423-4546-961c-96f1dc0a17dd tempest-VolumesSnapshotListTestJSON-1154159094 None] Created reservations ['38c61636-57e2-4cd3-8c15-d3c6403a80a3', 'ad28183b-de42-468d-a57b-2cec87fba93a', '9c061e47-ec05-4e70-9269-873f564eac36', '2d0231e7-ab5d-45c0-83ea-a33ae2d7305e'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:37:22 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-e8b9e909-5423-4546-961c-96f1dc0a17dd tempest-VolumesSnapshotListTestJSON-1154159094 None] Delete snapshot completed successfully. Jul 06 15:37:22 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e8b9e909-5423-4546-961c-96f1dc0a17dd tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "cinder-3d57516a-e9e3-4c5f-b6b5-0b640507382b-delete_snapshot" released by "delete_snapshot" :: held 3.721s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:22 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63.fad7f9d6-ebd4-4454-bea0-81262e487927 1G" returned: 0 in 1.030s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63.fad7f9d6-ebd4-4454-bea0-81262e487927 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:22 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63.fad7f9d6-ebd4-4454-bea0-81262e487927 Jul 06 15:37:22 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4ec739e3-de25-4694-8077-bdb0a672d682 tempest-VolumesSnapshotListTestJSON-1154159094 None] Acquiring lock "cinder-f4a894f6-8e41-4614-9303-0ff4f6b61508-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4ec739e3-de25-4694-8077-bdb0a672d682 tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "cinder-f4a894f6-8e41-4614-9303-0ff4f6b61508-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4ec739e3-de25-4694-8077-bdb0a672d682 tempest-VolumesSnapshotListTestJSON-1154159094 None] Acquiring lock "cinder-quobyte-0da52aa0-ca1e-4008-89e8-3cd1395743f2" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4ec739e3-de25-4694-8077-bdb0a672d682 tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "cinder-quobyte-0da52aa0-ca1e-4008-89e8-3cd1395743f2" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4ec739e3-de25-4694-8077-bdb0a672d682 tempest-VolumesSnapshotListTestJSON-1154159094 None] Acquiring lock "cinder-quobyte-f4a894f6-8e41-4614-9303-0ff4f6b61508" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4ec739e3-de25-4694-8077-bdb0a672d682 tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "cinder-quobyte-f4a894f6-8e41-4614-9303-0ff4f6b61508" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-4ec739e3-de25-4694-8077-bdb0a672d682 tempest-VolumesSnapshotListTestJSON-1154159094 None] Deleting offline snapshot f4a894f6-8e41-4614-9303-0ff4f6b61508 of volume 0da52aa0-ca1e-4008-89e8-3cd1395743f2 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:37:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-4ec739e3-de25-4694-8077-bdb0a672d682 tempest-VolumesSnapshotListTestJSON-1154159094 None] snapshot_file for this snap is: volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:37:23 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa307577-e64a-4746-b070-682ce0f95ed7]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4ec739e3-de25-4694-8077-bdb0a672d682 tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:23 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508 Jul 06 15:37:23 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:23 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63.fad7f9d6-ebd4-4454-bea0-81262e487927" returned: 0 in 0.825s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:23 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63.fad7f9d6-ebd4-4454-bea0-81262e487927 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 15:37:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63.fad7f9d6-ebd4-4454-bea0-81262e487927 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:23 devstack sudo[98463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63.fad7f9d6-ebd4-4454-bea0-81262e487927 Jul 06 15:37:23 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:24 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4ec739e3-de25-4694-8077-bdb0a672d682 tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508" returned: 0 in 0.849s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-4ec739e3-de25-4694-8077-bdb0a672d682 tempest-VolumesSnapshotListTestJSON-1154159094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:37:24 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b416331-28c3-49b8-92b9-602f6cc108b6]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4ec739e3-de25-4694-8077-bdb0a672d682 tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:24 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2 Jul 06 15:37:24 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:24 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63.fad7f9d6-ebd4-4454-bea0-81262e487927" returned: 0 in 0.693s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:24 devstack sudo[98473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63.info Jul 06 15:37:24 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:24 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4ec739e3-de25-4694-8077-bdb0a672d682 tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2" returned: 0 in 0.766s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4ec739e3-de25-4694-8077-bdb0a672d682 tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:24 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508 Jul 06 15:37:24 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:25 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63.info" returned: 0 in 0.656s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:25 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 15:37:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:25 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63.info Jul 06 15:37:25 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:25 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4ec739e3-de25-4694-8077-bdb0a672d682 tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508" returned: 0 in 0.963s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4ec739e3-de25-4694-8077-bdb0a672d682 tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:25 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508 Jul 06 15:37:25 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:25 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63.info" returned: 0 in 0.809s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.105s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-59adfddf-06b8-4df8-af54-5a57d58d1122 req-621c13ba-e602-4988-b0c0-d528f5d1ccdd tempest-TestStampPattern-150571277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.966s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:26 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccef937-3a96-4cee-8611-40c47b3919ef]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-59adfddf-06b8-4df8-af54-5a57d58d1122 req-621c13ba-e602-4988-b0c0-d528f5d1ccdd tempest-TestStampPattern-150571277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8132a75d-0fb3-4d8f-b2b2-d286de8595f9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:26 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-158b7382-ef67-4792-8154-57de5d599430 tempest-GroupSnapshotsTest-729188743 None] group_snapshot bc66d479-fdb3-4043-a555-cfb17f5db939: created successfully Jul 06 15:37:26 devstack sudo[98526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8132a75d-0fb3-4d8f-b2b2-d286de8595f9 Jul 06 15:37:26 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:26 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] group_snapshot bc66d479-fdb3-4043-a555-cfb17f5db939: deleting Jul 06 15:37:26 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] group_snapshot bc66d479-fdb3-4043-a555-cfb17f5db939: deleting {{(pid=86148) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 15:37:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "cinder-quobyte-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "cinder-quobyte-4971978c-6e9c-437e-a485-bec7eb5f8773" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:26 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-4971978c-6e9c-437e-a485-bec7eb5f8773" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:26 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] Deleting offline snapshot 4971978c-6e9c-437e-a485-bec7eb5f8773 of volume 9b5d2b24-3f3a-46c9-b96b-6c42c0103f05 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:37:26 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] snapshot_file for this snap is: volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05.4971978c-6e9c-437e-a485-bec7eb5f8773 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:37:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4ec739e3-de25-4694-8077-bdb0a672d682 tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2.f4a894f6-8e41-4614-9303-0ff4f6b61508" returned: 0 in 1.036s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:26 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49bd778-5f95-4e7b-8b81-81abb04a9c4d]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05.4971978c-6e9c-437e-a485-bec7eb5f8773 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4ec739e3-de25-4694-8077-bdb0a672d682 tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "cinder-quobyte-f4a894f6-8e41-4614-9303-0ff4f6b61508" released by "_delete_snapshot" :: held 3.760s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4ec739e3-de25-4694-8077-bdb0a672d682 tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "cinder-quobyte-0da52aa0-ca1e-4008-89e8-3cd1395743f2" released by "delete_snapshot" :: held 3.784s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:26 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-4ec739e3-de25-4694-8077-bdb0a672d682 tempest-VolumesSnapshotListTestJSON-1154159094 None] Created reservations ['0e76f703-2441-40fe-949c-44d3b23f312b', 'c790d813-dcfe-4da2-ac98-a82ca7f4a06d', 'fa3680f7-94be-47d7-956f-e63a70ab3179', 'cc3b48a7-3cfe-45fa-a015-9b76aa9eda98'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:37:27 devstack sudo[98539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05.4971978c-6e9c-437e-a485-bec7eb5f8773 Jul 06 15:37:27 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:27 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-4ec739e3-de25-4694-8077-bdb0a672d682 tempest-VolumesSnapshotListTestJSON-1154159094 None] Delete snapshot completed successfully. Jul 06 15:37:27 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4ec739e3-de25-4694-8077-bdb0a672d682 tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "cinder-f4a894f6-8e41-4614-9303-0ff4f6b61508-delete_snapshot" released by "delete_snapshot" :: held 3.944s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:27 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-59adfddf-06b8-4df8-af54-5a57d58d1122 req-621c13ba-e602-4988-b0c0-d528f5d1ccdd tempest-TestStampPattern-150571277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8132a75d-0fb3-4d8f-b2b2-d286de8595f9" returned: 0 in 1.185s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-59adfddf-06b8-4df8-af54-5a57d58d1122 req-621c13ba-e602-4988-b0c0-d528f5d1ccdd tempest-TestStampPattern-150571277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.232s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:27 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-59adfddf-06b8-4df8-af54-5a57d58d1122 req-621c13ba-e602-4988-b0c0-d528f5d1ccdd tempest-TestStampPattern-150571277 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce', 'name': 'volume-8132a75d-0fb3-4d8f-b2b2-d286de8595f9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ed2a7e1-f3c8-4761-9e12-53c48c6d93ff', 'enforce_multipath': True} {{(pid=86148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:37:27 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-59adfddf-06b8-4df8-af54-5a57d58d1122 req-621c13ba-e602-4988-b0c0-d528f5d1ccdd tempest-TestStampPattern-150571277 None] attachment_update completed successfully. Jul 06 15:37:27 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-72e93fe1-5df1-4362-990a-08ee9bcc8383 tempest-VolumesSnapshotListTestJSON-1154159094 None] Acquiring lock "cinder-0da52aa0-ca1e-4008-89e8-3cd1395743f2-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:27 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-72e93fe1-5df1-4362-990a-08ee9bcc8383 tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "cinder-0da52aa0-ca1e-4008-89e8-3cd1395743f2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:27 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-72e93fe1-5df1-4362-990a-08ee9bcc8383 tempest-VolumesSnapshotListTestJSON-1154159094 None] Acquiring lock "cinder-quobyte-0da52aa0-ca1e-4008-89e8-3cd1395743f2" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:27 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-72e93fe1-5df1-4362-990a-08ee9bcc8383 tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "cinder-quobyte-0da52aa0-ca1e-4008-89e8-3cd1395743f2" acquired by "delete_volume" :: waited 0.022s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:27 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3b2f40-a487-40d1-8814-03f635f6a6dd]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-72e93fe1-5df1-4362-990a-08ee9bcc8383 tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:27 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2 Jul 06 15:37:27 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:27 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05.4971978c-6e9c-437e-a485-bec7eb5f8773" returned: 0 in 1.086s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:27 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:37:28 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a65c4c5-c51b-4fbd-ab05-f8d8768af662]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:28 devstack sudo[98635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05 Jul 06 15:37:28 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:28 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-72e93fe1-5df1-4362-990a-08ee9bcc8383 tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2" returned: 0 in 0.932s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-72e93fe1-5df1-4362-990a-08ee9bcc8383 tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:28 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2 Jul 06 15:37:28 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:29 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05" returned: 0 in 1.000s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05.4971978c-6e9c-437e-a485-bec7eb5f8773 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:29 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05.4971978c-6e9c-437e-a485-bec7eb5f8773 Jul 06 15:37:29 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:29 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-72e93fe1-5df1-4362-990a-08ee9bcc8383 tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0da52aa0-ca1e-4008-89e8-3cd1395743f2" returned: 0 in 0.808s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-72e93fe1-5df1-4362-990a-08ee9bcc8383 tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "cinder-quobyte-0da52aa0-ca1e-4008-89e8-3cd1395743f2" released by "delete_volume" :: held 1.846s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:29 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-72e93fe1-5df1-4362-990a-08ee9bcc8383 tempest-VolumesSnapshotListTestJSON-1154159094 None] Created reservations ['d9e74fe4-12eb-4dae-a143-815d7c292a45', '04a1b592-fde6-4507-a27b-6319d31693cf', 'a78595f5-9fcd-4dc0-9cfe-701c53c73893', '5eb0dece-d792-43c6-b3d2-363cbcdf2821'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:37:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-72e93fe1-5df1-4362-990a-08ee9bcc8383 tempest-VolumesSnapshotListTestJSON-1154159094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-72e93fe1-5df1-4362-990a-08ee9bcc8383 tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:29 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-72e93fe1-5df1-4362-990a-08ee9bcc8383 tempest-VolumesSnapshotListTestJSON-1154159094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:37:29 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-72e93fe1-5df1-4362-990a-08ee9bcc8383 tempest-VolumesSnapshotListTestJSON-1154159094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:37:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-72e93fe1-5df1-4362-990a-08ee9bcc8383 tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-72e93fe1-5df1-4362-990a-08ee9bcc8383 tempest-VolumesSnapshotListTestJSON-1154159094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:29 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:37:29 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:29 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05.4971978c-6e9c-437e-a485-bec7eb5f8773" returned: 0 in 0.982s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05.4971978c-6e9c-437e-a485-bec7eb5f8773 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:30 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05.4971978c-6e9c-437e-a485-bec7eb5f8773 Jul 06 15:37:30 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:30 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-72e93fe1-5df1-4362-990a-08ee9bcc8383 tempest-VolumesSnapshotListTestJSON-1154159094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.008s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:30 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-72e93fe1-5df1-4362-990a-08ee9bcc8383 tempest-VolumesSnapshotListTestJSON-1154159094 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:37:30 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-72e93fe1-5df1-4362-990a-08ee9bcc8383 tempest-VolumesSnapshotListTestJSON-1154159094 None] Deleted volume successfully. Jul 06 15:37:30 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-72e93fe1-5df1-4362-990a-08ee9bcc8383 tempest-VolumesSnapshotListTestJSON-1154159094 None] Lock "cinder-0da52aa0-ca1e-4008-89e8-3cd1395743f2-delete_volume" released by "delete_volume" :: held 3.138s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:31 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05.4971978c-6e9c-437e-a485-bec7eb5f8773" returned: 0 in 1.146s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:31 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-4971978c-6e9c-437e-a485-bec7eb5f8773" released by "_delete_snapshot" :: held 4.362s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:31 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05" released by "delete_snapshot" :: held 4.396s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:31 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "cinder-quobyte-f2985ca0-c420-44ff-9cf9-aee476e4fe63" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:31 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-f2985ca0-c420-44ff-9cf9-aee476e4fe63" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:31 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "cinder-quobyte-fad7f9d6-ebd4-4454-bea0-81262e487927" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:31 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-fad7f9d6-ebd4-4454-bea0-81262e487927" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:31 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] Deleting offline snapshot fad7f9d6-ebd4-4454-bea0-81262e487927 of volume f2985ca0-c420-44ff-9cf9-aee476e4fe63 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:37:31 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] snapshot_file for this snap is: volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63.fad7f9d6-ebd4-4454-bea0-81262e487927 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:37:31 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f72311f-4e15-49c9-a4f9-7cc9d3869e52]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63.fad7f9d6-ebd4-4454-bea0-81262e487927 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:31 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63.fad7f9d6-ebd4-4454-bea0-81262e487927 Jul 06 15:37:31 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:32 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63.fad7f9d6-ebd4-4454-bea0-81262e487927" returned: 0 in 1.079s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:32 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:37:32 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[e649ea6b-66bd-4c17-a134-c48dfd85b13c]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:32 devstack sudo[98995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63 Jul 06 15:37:32 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:32 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:37:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Flow 'volume_create_manager' (793ab3a1-1b96-4854-b81e-5c369454c4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:37:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bde5ae2-53c4-48f5-8480-73fd2be36de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bde5ae2-53c4-48f5-8480-73fd2be36de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1086186207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28b212f-ce36-4786-8ebd-c4cec70d0a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fcccea57dcf409e9187be2f2b7ef405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:33Z,use_quota=True,user_id='86ca6aaa78d54965a8a4b8dbf5e0c544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d1a9ba-9096-46cf-acc7-dead01412d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d1a9ba-9096-46cf-acc7-dead01412d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927b1ad3-c10b-47a5-83e0-331bf45ba3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927b1ad3-c10b-47a5-83e0-331bf45ba3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f28b212f-ce36-4786-8ebd-c4cec70d0a44', 'volume_name': 'volume-f28b212f-ce36-4786-8ebd-c4cec70d0a44', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cde127a-e7a1-4575-aea1-2c1df74bb57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cde127a-e7a1-4575-aea1-2c1df74bb57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0660a02c-fa3c-4e25-9b8b-5c14399040ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:32 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Volume f28b212f-ce36-4786-8ebd-c4cec70d0a44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f28b212f-ce36-4786-8ebd-c4cec70d0a44', 'volume_size': 1} Jul 06 15:37:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:32 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1086186207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28b212f-ce36-4786-8ebd-c4cec70d0a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fcccea57dcf409e9187be2f2b7ef405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:33Z,use_quota=True,user_id='86ca6aaa78d54965a8a4b8dbf5e0c544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:37:32 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Creating volume f28b212f-ce36-4786-8ebd-c4cec70d0a44 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:37:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:32 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:37:32 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:37:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:32 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:37:32 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:37:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f28b212f-ce36-4786-8ebd-c4cec70d0a44 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:32 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f28b212f-ce36-4786-8ebd-c4cec70d0a44 1073741824 Jul 06 15:37:32 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:33 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63" returned: 0 in 1.332s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63.fad7f9d6-ebd4-4454-bea0-81262e487927 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:33 devstack sudo[99009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63.fad7f9d6-ebd4-4454-bea0-81262e487927 Jul 06 15:37:33 devstack sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:34 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f28b212f-ce36-4786-8ebd-c4cec70d0a44 1073741824" returned: 0 in 1.202s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f28b212f-ce36-4786-8ebd-c4cec70d0a44 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:34 devstack sudo[99012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f28b212f-ce36-4786-8ebd-c4cec70d0a44 Jul 06 15:37:34 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:34 devstack sudo[99009]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63.fad7f9d6-ebd4-4454-bea0-81262e487927" returned: 0 in 1.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63.fad7f9d6-ebd4-4454-bea0-81262e487927 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:34 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63.fad7f9d6-ebd4-4454-bea0-81262e487927 Jul 06 15:37:34 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:35 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-77fac697-3bee-49a9-a6e1-5b88a5e0fd9a req-548cd978-1cd2-467d-a377-74d9ab89e1ab tempest-TestStampPattern-150571277 None] Terminate volume connection completed successfully. Jul 06 15:37:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-77fac697-3bee-49a9-a6e1-5b88a5e0fd9a req-548cd978-1cd2-467d-a377-74d9ab89e1ab tempest-TestStampPattern-150571277 None] Deleting attachment 9ed2a7e1-f3c8-4761-9e12-53c48c6d93ff. {{(pid=86148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:37:35 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f28b212f-ce36-4786-8ebd-c4cec70d0a44" returned: 0 in 0.911s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:35 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] <== create_volume: return (2182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:37:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.185s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0660a02c-fa3c-4e25-9b8b-5c14399040ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f28b212f-ce36-4786-8ebd-c4cec70d0a44', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b78a0a65-008c-4015-9b7d-e509f3b8c6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:35 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Volume volume-f28b212f-ce36-4786-8ebd-c4cec70d0a44 (f28b212f-ce36-4786-8ebd-c4cec70d0a44): created successfully Jul 06 15:37:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b78a0a65-008c-4015-9b7d-e509f3b8c6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Flow 'volume_create_manager' (793ab3a1-1b96-4854-b81e-5c369454c4a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:37:35 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-24d15401-4225-4aa1-86d6-9c9e30bede3c tempest-TestMinimumBasicScenario-523968004 None] Created volume successfully. Jul 06 15:37:35 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63.fad7f9d6-ebd4-4454-bea0-81262e487927" returned: 0 in 0.941s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-fad7f9d6-ebd4-4454-bea0-81262e487927" released by "_delete_snapshot" :: held 4.553s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-f2985ca0-c420-44ff-9cf9-aee476e4fe63" released by "delete_snapshot" :: held 4.602s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:35 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=100,cinder:INSERT=21,cinder:UPDATE=93,cinder:DELETE=3 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:37:35 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=96,cinder:INSERT=24,cinder:UPDATE=96,cinder:DELETE=7 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:37:35 devstack cinder-volume[86148]: WARNING cinder.quota [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-776339789 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-776339789, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:37:35 devstack cinder-volume[86148]: WARNING cinder.quota [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-776339789 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-776339789, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:37:35 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] Created reservations ['32cab3f1-66c0-4067-9dac-e1e2f42dd0eb', '18160390-20dd-4cbd-afd8-a8ae964fd687', '1e4645e6-f9dc-4f0a-93ef-532de5f49e20', 'ec1dc482-001f-4830-911e-180c10fa34c8'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:37:36 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] Created reservations ['590fceec-fa1c-445c-9093-91cebc089283', 'eb0e8cf2-2437-402c-8f2f-458f9d048d0f', 'd55eee1b-e7f2-4cbd-adbb-54273bd8fc2c', 'efd26e12-6b84-47fb-8463-1e40e7cc73f9'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:37:36 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-946a2db7-0d1d-4cfa-8bc9-4d0269831df8 tempest-GroupSnapshotsTest-729188743 None] group_snapshot bc66d479-fdb3-4043-a555-cfb17f5db939: deleted successfully Jul 06 15:37:37 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-471b70a0-ba28-420a-9639-74f3321e231a tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "cinder-quobyte-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:37 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-471b70a0-ba28-420a-9639-74f3321e231a tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05" acquired by "delete_volume" :: waited 0.028s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:37 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c75f0d-a0b9-4fab-846d-b13449ea0f53]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-471b70a0-ba28-420a-9639-74f3321e231a tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:37 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05 Jul 06 15:37:37 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:38 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-471b70a0-ba28-420a-9639-74f3321e231a tempest-GroupSnapshotsTest-729188743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05" returned: 0 in 1.007s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-471b70a0-ba28-420a-9639-74f3321e231a tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:38 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05 Jul 06 15:37:38 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:37:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:37:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:37:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:38 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:37:38 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:39 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-471b70a0-ba28-420a-9639-74f3321e231a tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05" returned: 0 in 1.303s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:39 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-471b70a0-ba28-420a-9639-74f3321e231a tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-9b5d2b24-3f3a-46c9-b96b-6c42c0103f05" released by "delete_volume" :: held 2.403s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:39 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-471b70a0-ba28-420a-9639-74f3321e231a tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "cinder-quobyte-f2985ca0-c420-44ff-9cf9-aee476e4fe63" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:39 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-471b70a0-ba28-420a-9639-74f3321e231a tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-f2985ca0-c420-44ff-9cf9-aee476e4fe63" acquired by "delete_volume" :: waited 0.034s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:39 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[e017bc38-2a9f-4831-8e1e-ac4a5de01102]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-471b70a0-ba28-420a-9639-74f3321e231a tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:39 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63 Jul 06 15:37:39 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:39 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.527s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:37:40 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager._thread_info {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:37:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread count: 28 {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:37:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread info: [<_MainThread(MainThread, started 124857273856128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:37:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-723876f2-ca15-4209-b2c4-8dbcfc212aee req-20779305-0418-403f-990e-5e8687ae7ea6 tempest-TestMinimumBasicScenario-523968004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-723876f2-ca15-4209-b2c4-8dbcfc212aee req-20779305-0418-403f-990e-5e8687ae7ea6 tempest-TestMinimumBasicScenario-523968004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:40 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[741a8aa2-a096-496c-a122-e289acf634f7]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-723876f2-ca15-4209-b2c4-8dbcfc212aee req-20779305-0418-403f-990e-5e8687ae7ea6 tempest-TestMinimumBasicScenario-523968004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f28b212f-ce36-4786-8ebd-c4cec70d0a44 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:40 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f28b212f-ce36-4786-8ebd-c4cec70d0a44 Jul 06 15:37:40 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:41 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-471b70a0-ba28-420a-9639-74f3321e231a tempest-GroupSnapshotsTest-729188743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63" returned: 0 in 1.617s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-471b70a0-ba28-420a-9639-74f3321e231a tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:41 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63 Jul 06 15:37:41 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:41 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-723876f2-ca15-4209-b2c4-8dbcfc212aee req-20779305-0418-403f-990e-5e8687ae7ea6 tempest-TestMinimumBasicScenario-523968004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f28b212f-ce36-4786-8ebd-c4cec70d0a44" returned: 0 in 1.685s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-723876f2-ca15-4209-b2c4-8dbcfc212aee req-20779305-0418-403f-990e-5e8687ae7ea6 tempest-TestMinimumBasicScenario-523968004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.726s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:41 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-723876f2-ca15-4209-b2c4-8dbcfc212aee req-20779305-0418-403f-990e-5e8687ae7ea6 tempest-TestMinimumBasicScenario-523968004 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce', 'name': 'volume-f28b212f-ce36-4786-8ebd-c4cec70d0a44', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '302f80c3-945d-4deb-a2ae-de970364f700', 'enforce_multipath': True} {{(pid=86148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:37:42 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-723876f2-ca15-4209-b2c4-8dbcfc212aee req-20779305-0418-403f-990e-5e8687ae7ea6 tempest-TestMinimumBasicScenario-523968004 None] attachment_update completed successfully. Jul 06 15:37:42 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-471b70a0-ba28-420a-9639-74f3321e231a tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f2985ca0-c420-44ff-9cf9-aee476e4fe63" returned: 0 in 1.162s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:42 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-471b70a0-ba28-420a-9639-74f3321e231a tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-f2985ca0-c420-44ff-9cf9-aee476e4fe63" released by "delete_volume" :: held 2.881s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:42 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-471b70a0-ba28-420a-9639-74f3321e231a tempest-GroupSnapshotsTest-729188743 None] Created reservations ['03fb7cd8-23f1-41c1-aae4-6c8144f81aaa'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:37:42 devstack cinder-volume[86148]: WARNING cinder.quota [None req-471b70a0-ba28-420a-9639-74f3321e231a tempest-GroupSnapshotsTest-729188743 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-776339789 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-776339789, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:37:42 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-471b70a0-ba28-420a-9639-74f3321e231a tempest-GroupSnapshotsTest-729188743 None] Created reservations ['4f0aa480-9138-40f0-aafa-1158fdb5aa44', 'd7cea331-bb5b-4b87-bddd-f68ecc501270', '64dd2771-4106-49bf-8897-4b83d9a092c8', '03b66bfb-7202-46d3-9c18-be9bf1cfa68a'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:37:42 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-471b70a0-ba28-420a-9639-74f3321e231a tempest-GroupSnapshotsTest-729188743 None] Created reservations ['4ee64dd5-fb8f-4857-a627-66532ae1e25a', '47a89c5a-1a04-4c01-8b0e-0226de0ff67b', '0af10ece-de83-41bf-9c5f-43a0d122e9aa', 'f824c492-622d-484a-8b74-fc8b3c0ba473'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:37:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-471b70a0-ba28-420a-9639-74f3321e231a tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-471b70a0-ba28-420a-9639-74f3321e231a tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:42 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-471b70a0-ba28-420a-9639-74f3321e231a tempest-GroupSnapshotsTest-729188743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:37:42 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-471b70a0-ba28-420a-9639-74f3321e231a tempest-GroupSnapshotsTest-729188743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:37:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-471b70a0-ba28-420a-9639-74f3321e231a tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-471b70a0-ba28-420a-9639-74f3321e231a tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:42 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:37:42 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:43 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-912bea95-fe27-4c09-8f57-14b6e7c9c141 tempest-GroupSnapshotsTest-729188743 None] Group tempest-GroupSnapshotsTest-Group-1339176727: creating Jul 06 15:37:43 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-912bea95-fe27-4c09-8f57-14b6e7c9c141 tempest-GroupSnapshotsTest-729188743 None] Group tempest-GroupSnapshotsTest-Group-1339176727: created successfully Jul 06 15:37:43 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-912bea95-fe27-4c09-8f57-14b6e7c9c141 tempest-GroupSnapshotsTest-729188743 None] Create group completed successfully. Jul 06 15:37:43 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-471b70a0-ba28-420a-9639-74f3321e231a tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.930s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:43 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-471b70a0-ba28-420a-9639-74f3321e231a tempest-GroupSnapshotsTest-729188743 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:37:43 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-471b70a0-ba28-420a-9639-74f3321e231a tempest-GroupSnapshotsTest-729188743 None] Delete group completed successfully. Jul 06 15:37:45 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:37:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Flow 'volume_create_manager' (1e1bfabc-5be3-45fc-b347-a36095ebbd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:37:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f01aa59-2277-4229-984c-5b2f474b5bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f01aa59-2277-4229-984c-5b2f474b5bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1511899141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=85da4de2-90cb-4385-a31f-bd4058985485,host='devstack@QuobyteHD#QuobyteHD',id=5cf7c167-94dc-4093-be96-90bf808d913a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a2e8e36e05845e6b70b3678e743370c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:45Z,use_quota=True,user_id='cd3548cd12eb48df879c2b63da879e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d80337a-f5e3-40b5-9874-83d3e753feed),volume_type_id=6d80337a-f5e3-40b5-9874-83d3e753feed)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c3cf36-09b4-49ee-adc4-53645e1f3580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c3cf36-09b4-49ee-adc4-53645e1f3580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e64db81-dd7c-4267-970c-77aa23aed903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e64db81-dd7c-4267-970c-77aa23aed903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cf7c167-94dc-4093-be96-90bf808d913a', 'volume_name': 'volume-5cf7c167-94dc-4093-be96-90bf808d913a', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9320854d-40d2-46ba-b825-f8740e9873f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9320854d-40d2-46ba-b825-f8740e9873f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15574561-aba9-4522-9377-bdf47dea8b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:45 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Volume 5cf7c167-94dc-4093-be96-90bf808d913a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cf7c167-94dc-4093-be96-90bf808d913a', 'volume_size': 1} Jul 06 15:37:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=85da4de2-90cb-4385-a31f-bd4058985485,created_at=2026-07-06T13:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1511899141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=85da4de2-90cb-4385-a31f-bd4058985485,host='devstack@QuobyteHD#QuobyteHD',id=5cf7c167-94dc-4093-be96-90bf808d913a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a2e8e36e05845e6b70b3678e743370c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:45Z,use_quota=True,user_id='cd3548cd12eb48df879c2b63da879e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d80337a-f5e3-40b5-9874-83d3e753feed),volume_type_id=6d80337a-f5e3-40b5-9874-83d3e753feed)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:37:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Creating volume 5cf7c167-94dc-4093-be96-90bf808d913a {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:37:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:37:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:37:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:37:45 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:37:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:45 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a 1073741824 Jul 06 15:37:45 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-7f5bcd0f-c620-41f9-bc47-4131179c1bad tempest-TestStampPattern-150571277 None] Acquiring lock "cinder-8132a75d-0fb3-4d8f-b2b2-d286de8595f9-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-7f5bcd0f-c620-41f9-bc47-4131179c1bad tempest-TestStampPattern-150571277 None] Lock "cinder-8132a75d-0fb3-4d8f-b2b2-d286de8595f9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:46 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a 1073741824" returned: 0 in 0.959s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-7f5bcd0f-c620-41f9-bc47-4131179c1bad tempest-TestStampPattern-150571277 None] Acquiring lock "cinder-quobyte-8132a75d-0fb3-4d8f-b2b2-d286de8595f9" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-7f5bcd0f-c620-41f9-bc47-4131179c1bad tempest-TestStampPattern-150571277 None] Lock "cinder-quobyte-8132a75d-0fb3-4d8f-b2b2-d286de8595f9" acquired by "delete_volume" :: waited 0.021s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:46 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30c75d6-4192-4a6c-94c3-82ec6794296b]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7f5bcd0f-c620-41f9-bc47-4131179c1bad tempest-TestStampPattern-150571277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8132a75d-0fb3-4d8f-b2b2-d286de8595f9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:46 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a Jul 06 15:37:46 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:46 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8132a75d-0fb3-4d8f-b2b2-d286de8595f9 Jul 06 15:37:46 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:47 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a" returned: 0 in 0.887s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:47 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:37:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.928s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:47 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15574561-aba9-4522-9377-bdf47dea8b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cf7c167-94dc-4093-be96-90bf808d913a', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:47 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a92aaa9-4748-492a-bb5b-5e7adadef9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:47 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Volume volume-5cf7c167-94dc-4093-be96-90bf808d913a (5cf7c167-94dc-4093-be96-90bf808d913a): created successfully Jul 06 15:37:47 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a92aaa9-4748-492a-bb5b-5e7adadef9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:47 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Flow 'volume_create_manager' (1e1bfabc-5be3-45fc-b347-a36095ebbd71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:37:47 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-bac32d68-b1e1-4237-8d05-170a7cfeed2d tempest-GroupSnapshotsTest-729188743 None] Created volume successfully. Jul 06 15:37:47 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7f5bcd0f-c620-41f9-bc47-4131179c1bad tempest-TestStampPattern-150571277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8132a75d-0fb3-4d8f-b2b2-d286de8595f9" returned: 0 in 1.009s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7f5bcd0f-c620-41f9-bc47-4131179c1bad tempest-TestStampPattern-150571277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8132a75d-0fb3-4d8f-b2b2-d286de8595f9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:47 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8132a75d-0fb3-4d8f-b2b2-d286de8595f9 Jul 06 15:37:47 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:48 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-af4905d5-9d0b-4c85-8714-d31569550d50 tempest-GroupSnapshotsTest-729188743 None] GroupSnapshot 22b3f345-7936-4214-8b6e-c10d2e1c8c0f: creating. Jul 06 15:37:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-af4905d5-9d0b-4c85-8714-d31569550d50 tempest-GroupSnapshotsTest-729188743 None] Group snapshot 22b3f345-7936-4214-8b6e-c10d2e1c8c0f: creating. {{(pid=86148) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 15:37:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-af4905d5-9d0b-4c85-8714-d31569550d50 tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-af4905d5-9d0b-4c85-8714-d31569550d50 tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:48 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-af4905d5-9d0b-4c85-8714-d31569550d50 tempest-GroupSnapshotsTest-729188743 None] Creating offline snapshot f814d373-88a1-4a2a-a577-e8705b964000 of volume 5cf7c167-94dc-4093-be96-90bf808d913a {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:37:48 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ca26b5-0bf7-4681-8fc3-b137a70fc2d1]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-af4905d5-9d0b-4c85-8714-d31569550d50 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:48 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a Jul 06 15:37:48 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:48 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7f5bcd0f-c620-41f9-bc47-4131179c1bad tempest-TestStampPattern-150571277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8132a75d-0fb3-4d8f-b2b2-d286de8595f9" returned: 0 in 1.205s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-7f5bcd0f-c620-41f9-bc47-4131179c1bad tempest-TestStampPattern-150571277 None] Lock "cinder-quobyte-8132a75d-0fb3-4d8f-b2b2-d286de8595f9" released by "delete_volume" :: held 2.289s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:48 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-7f5bcd0f-c620-41f9-bc47-4131179c1bad tempest-TestStampPattern-150571277 None] Created reservations ['f7ed2b7a-692d-4ebf-8e9d-15fab9b7e891', '34d3d251-ae48-43e6-a59b-1483dd31c255', '1b2ea0f4-0db3-4183-aeba-f38e41203daa', 'c29f9e6d-dca0-43ed-b8f2-5d7857a26d83'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:37:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7f5bcd0f-c620-41f9-bc47-4131179c1bad tempest-TestStampPattern-150571277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7f5bcd0f-c620-41f9-bc47-4131179c1bad tempest-TestStampPattern-150571277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:48 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-7f5bcd0f-c620-41f9-bc47-4131179c1bad tempest-TestStampPattern-150571277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:37:48 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-7f5bcd0f-c620-41f9-bc47-4131179c1bad tempest-TestStampPattern-150571277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:37:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7f5bcd0f-c620-41f9-bc47-4131179c1bad tempest-TestStampPattern-150571277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7f5bcd0f-c620-41f9-bc47-4131179c1bad tempest-TestStampPattern-150571277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:49 devstack sudo[99569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:37:49 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:49 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-af4905d5-9d0b-4c85-8714-d31569550d50 tempest-GroupSnapshotsTest-729188743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a" returned: 0 in 1.297s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-af4905d5-9d0b-4c85-8714-d31569550d50 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a.f814d373-88a1-4a2a-a577-e8705b964000 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:49 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a.f814d373-88a1-4a2a-a577-e8705b964000 1G Jul 06 15:37:49 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:50 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7f5bcd0f-c620-41f9-bc47-4131179c1bad tempest-TestStampPattern-150571277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.097s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:50 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-7f5bcd0f-c620-41f9-bc47-4131179c1bad tempest-TestStampPattern-150571277 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:37:50 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-7f5bcd0f-c620-41f9-bc47-4131179c1bad tempest-TestStampPattern-150571277 None] Deleted volume successfully. Jul 06 15:37:50 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-7f5bcd0f-c620-41f9-bc47-4131179c1bad tempest-TestStampPattern-150571277 None] Lock "cinder-8132a75d-0fb3-4d8f-b2b2-d286de8595f9-delete_volume" released by "delete_volume" :: held 3.790s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:50 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-061e5aa3-678b-4cac-ab7e-e2c75882655f tempest-TestStampPattern-150571277 None] Acquiring lock "cinder-4c9f30d1-0009-4e41-b6ff-41f2a20c0103-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:50 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-061e5aa3-678b-4cac-ab7e-e2c75882655f tempest-TestStampPattern-150571277 None] Lock "cinder-4c9f30d1-0009-4e41-b6ff-41f2a20c0103-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:50 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-061e5aa3-678b-4cac-ab7e-e2c75882655f tempest-TestStampPattern-150571277 None] Acquiring lock "cinder-quobyte-5c568390-9d78-48fe-845c-2f90ff72701b" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:50 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-061e5aa3-678b-4cac-ab7e-e2c75882655f tempest-TestStampPattern-150571277 None] Lock "cinder-quobyte-5c568390-9d78-48fe-845c-2f90ff72701b" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:50 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-061e5aa3-678b-4cac-ab7e-e2c75882655f tempest-TestStampPattern-150571277 None] Acquiring lock "cinder-quobyte-4c9f30d1-0009-4e41-b6ff-41f2a20c0103" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:50 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-061e5aa3-678b-4cac-ab7e-e2c75882655f tempest-TestStampPattern-150571277 None] Lock "cinder-quobyte-4c9f30d1-0009-4e41-b6ff-41f2a20c0103" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:50 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-061e5aa3-678b-4cac-ab7e-e2c75882655f tempest-TestStampPattern-150571277 None] Deleting offline snapshot 4c9f30d1-0009-4e41-b6ff-41f2a20c0103 of volume 5c568390-9d78-48fe-845c-2f90ff72701b {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:37:50 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-061e5aa3-678b-4cac-ab7e-e2c75882655f tempest-TestStampPattern-150571277 None] snapshot_file for this snap is: volume-5c568390-9d78-48fe-845c-2f90ff72701b.4c9f30d1-0009-4e41-b6ff-41f2a20c0103 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:37:50 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06814bf-1dfb-43cb-920b-4f1fd7b5ef07]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-061e5aa3-678b-4cac-ab7e-e2c75882655f tempest-TestStampPattern-150571277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.4c9f30d1-0009-4e41-b6ff-41f2a20c0103 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:50 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.4c9f30d1-0009-4e41-b6ff-41f2a20c0103 Jul 06 15:37:50 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:51 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-af4905d5-9d0b-4c85-8714-d31569550d50 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a.f814d373-88a1-4a2a-a577-e8705b964000 1G" returned: 0 in 1.437s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-af4905d5-9d0b-4c85-8714-d31569550d50 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cf7c167-94dc-4093-be96-90bf808d913a -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a.f814d373-88a1-4a2a-a577-e8705b964000 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:51 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cf7c167-94dc-4093-be96-90bf808d913a -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a.f814d373-88a1-4a2a-a577-e8705b964000 Jul 06 15:37:51 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:51 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-061e5aa3-678b-4cac-ab7e-e2c75882655f tempest-TestStampPattern-150571277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.4c9f30d1-0009-4e41-b6ff-41f2a20c0103" returned: 0 in 1.043s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-061e5aa3-678b-4cac-ab7e-e2c75882655f tempest-TestStampPattern-150571277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c568390-9d78-48fe-845c-2f90ff72701b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:37:51 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cf14fc-4e0e-4000-bdb4-43a3176c2ec2]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-061e5aa3-678b-4cac-ab7e-e2c75882655f tempest-TestStampPattern-150571277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:51 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b Jul 06 15:37:51 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:52 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-af4905d5-9d0b-4c85-8714-d31569550d50 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cf7c167-94dc-4093-be96-90bf808d913a -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a.f814d373-88a1-4a2a-a577-e8705b964000" returned: 0 in 1.044s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:52 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-af4905d5-9d0b-4c85-8714-d31569550d50 tempest-GroupSnapshotsTest-729188743 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a.f814d373-88a1-4a2a-a577-e8705b964000 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 15:37:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-af4905d5-9d0b-4c85-8714-d31569550d50 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a.f814d373-88a1-4a2a-a577-e8705b964000 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:52 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a.f814d373-88a1-4a2a-a577-e8705b964000 Jul 06 15:37:52 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:52 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-061e5aa3-678b-4cac-ab7e-e2c75882655f tempest-TestStampPattern-150571277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b" returned: 0 in 0.972s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-061e5aa3-678b-4cac-ab7e-e2c75882655f tempest-TestStampPattern-150571277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.4c9f30d1-0009-4e41-b6ff-41f2a20c0103 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:52 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.4c9f30d1-0009-4e41-b6ff-41f2a20c0103 Jul 06 15:37:52 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:53 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-af4905d5-9d0b-4c85-8714-d31569550d50 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a.f814d373-88a1-4a2a-a577-e8705b964000" returned: 0 in 0.908s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-af4905d5-9d0b-4c85-8714-d31569550d50 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:53 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a.info Jul 06 15:37:53 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:53 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-061e5aa3-678b-4cac-ab7e-e2c75882655f tempest-TestStampPattern-150571277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.4c9f30d1-0009-4e41-b6ff-41f2a20c0103" returned: 0 in 1.206s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-061e5aa3-678b-4cac-ab7e-e2c75882655f tempest-TestStampPattern-150571277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.4c9f30d1-0009-4e41-b6ff-41f2a20c0103 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:53 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.4c9f30d1-0009-4e41-b6ff-41f2a20c0103 Jul 06 15:37:53 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:53 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-af4905d5-9d0b-4c85-8714-d31569550d50 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a.info" returned: 0 in 0.857s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:53 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-af4905d5-9d0b-4c85-8714-d31569550d50 tempest-GroupSnapshotsTest-729188743 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 15:37:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-af4905d5-9d0b-4c85-8714-d31569550d50 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:53 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a.info Jul 06 15:37:53 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:54 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-061e5aa3-678b-4cac-ab7e-e2c75882655f tempest-TestStampPattern-150571277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b.4c9f30d1-0009-4e41-b6ff-41f2a20c0103" returned: 0 in 1.108s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-061e5aa3-678b-4cac-ab7e-e2c75882655f tempest-TestStampPattern-150571277 None] Lock "cinder-quobyte-4c9f30d1-0009-4e41-b6ff-41f2a20c0103" released by "_delete_snapshot" :: held 4.478s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-061e5aa3-678b-4cac-ab7e-e2c75882655f tempest-TestStampPattern-150571277 None] Lock "cinder-quobyte-5c568390-9d78-48fe-845c-2f90ff72701b" released by "delete_snapshot" :: held 4.519s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:54 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-af4905d5-9d0b-4c85-8714-d31569550d50 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a.info" returned: 0 in 1.009s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-af4905d5-9d0b-4c85-8714-d31569550d50 tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.667s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:54 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-061e5aa3-678b-4cac-ab7e-e2c75882655f tempest-TestStampPattern-150571277 None] Created reservations ['f8f825f5-181b-40bd-a2b1-d4ffe0b43227', 'a3b43ba7-a849-4842-8bf6-72e7318bec76', 'ce0187b3-eb8e-411c-9fd3-5f1d0b381559', '891eae91-e73e-4097-9970-5af13d65fd80'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:37:55 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-af4905d5-9d0b-4c85-8714-d31569550d50 tempest-GroupSnapshotsTest-729188743 None] group_snapshot 22b3f345-7936-4214-8b6e-c10d2e1c8c0f: created successfully Jul 06 15:37:55 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-061e5aa3-678b-4cac-ab7e-e2c75882655f tempest-TestStampPattern-150571277 None] Delete snapshot completed successfully. Jul 06 15:37:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-061e5aa3-678b-4cac-ab7e-e2c75882655f tempest-TestStampPattern-150571277 None] Lock "cinder-4c9f30d1-0009-4e41-b6ff-41f2a20c0103-delete_snapshot" released by "delete_snapshot" :: held 4.812s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:55 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-39be50f7-99dd-4f2b-aff6-7ffee3d879cf tempest-GroupSnapshotsTest-729188743 None] group_snapshot 22b3f345-7936-4214-8b6e-c10d2e1c8c0f: deleting Jul 06 15:37:55 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-39be50f7-99dd-4f2b-aff6-7ffee3d879cf tempest-GroupSnapshotsTest-729188743 None] group_snapshot 22b3f345-7936-4214-8b6e-c10d2e1c8c0f: deleting {{(pid=86148) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 15:37:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-39be50f7-99dd-4f2b-aff6-7ffee3d879cf tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "cinder-quobyte-5cf7c167-94dc-4093-be96-90bf808d913a" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-39be50f7-99dd-4f2b-aff6-7ffee3d879cf tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-5cf7c167-94dc-4093-be96-90bf808d913a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-39be50f7-99dd-4f2b-aff6-7ffee3d879cf tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "cinder-quobyte-f814d373-88a1-4a2a-a577-e8705b964000" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-39be50f7-99dd-4f2b-aff6-7ffee3d879cf tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-f814d373-88a1-4a2a-a577-e8705b964000" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-39be50f7-99dd-4f2b-aff6-7ffee3d879cf tempest-GroupSnapshotsTest-729188743 None] Deleting offline snapshot f814d373-88a1-4a2a-a577-e8705b964000 of volume 5cf7c167-94dc-4093-be96-90bf808d913a {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:37:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-39be50f7-99dd-4f2b-aff6-7ffee3d879cf tempest-GroupSnapshotsTest-729188743 None] snapshot_file for this snap is: volume-5cf7c167-94dc-4093-be96-90bf808d913a.f814d373-88a1-4a2a-a577-e8705b964000 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:37:56 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff1e1b7-891d-46e0-9611-c046b93dd5f0]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-39be50f7-99dd-4f2b-aff6-7ffee3d879cf tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a.f814d373-88a1-4a2a-a577-e8705b964000 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:56 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a.f814d373-88a1-4a2a-a577-e8705b964000 Jul 06 15:37:56 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:57 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-39be50f7-99dd-4f2b-aff6-7ffee3d879cf tempest-GroupSnapshotsTest-729188743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a.f814d373-88a1-4a2a-a577-e8705b964000" returned: 0 in 1.081s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:57 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-39be50f7-99dd-4f2b-aff6-7ffee3d879cf tempest-GroupSnapshotsTest-729188743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5cf7c167-94dc-4093-be96-90bf808d913a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:37:57 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec74fd0-7540-4cdc-aace-e744984f85c1]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-39be50f7-99dd-4f2b-aff6-7ffee3d879cf tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:57 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a Jul 06 15:37:57 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:58 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-39be50f7-99dd-4f2b-aff6-7ffee3d879cf tempest-GroupSnapshotsTest-729188743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a" returned: 0 in 1.005s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-39be50f7-99dd-4f2b-aff6-7ffee3d879cf tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a.f814d373-88a1-4a2a-a577-e8705b964000 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:58 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a.f814d373-88a1-4a2a-a577-e8705b964000 Jul 06 15:37:58 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:59 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-39be50f7-99dd-4f2b-aff6-7ffee3d879cf tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a.f814d373-88a1-4a2a-a577-e8705b964000" returned: 0 in 0.879s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-39be50f7-99dd-4f2b-aff6-7ffee3d879cf tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a.f814d373-88a1-4a2a-a577-e8705b964000 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:59 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a.f814d373-88a1-4a2a-a577-e8705b964000 Jul 06 15:37:59 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:00 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-39be50f7-99dd-4f2b-aff6-7ffee3d879cf tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a.f814d373-88a1-4a2a-a577-e8705b964000" returned: 0 in 0.955s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:00 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-39be50f7-99dd-4f2b-aff6-7ffee3d879cf tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-f814d373-88a1-4a2a-a577-e8705b964000" released by "_delete_snapshot" :: held 4.097s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:00 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-39be50f7-99dd-4f2b-aff6-7ffee3d879cf tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-5cf7c167-94dc-4093-be96-90bf808d913a" released by "delete_snapshot" :: held 4.123s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:00 devstack cinder-volume[86148]: WARNING cinder.quota [None req-39be50f7-99dd-4f2b-aff6-7ffee3d879cf tempest-GroupSnapshotsTest-729188743 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-746416287 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-746416287, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:38:00 devstack cinder-volume[86148]: WARNING cinder.quota [None req-39be50f7-99dd-4f2b-aff6-7ffee3d879cf tempest-GroupSnapshotsTest-729188743 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-746416287 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-746416287, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:38:00 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-39be50f7-99dd-4f2b-aff6-7ffee3d879cf tempest-GroupSnapshotsTest-729188743 None] Created reservations ['eec0bb24-5d45-4959-9ba0-afc67a6aaa17', 'ed3d7783-b624-4ddc-83f0-b6ef18c6c79b', '7f3c4078-21af-4f19-ba96-970aea9e1e76', '1ecf31d4-e775-486b-916a-4bdda6a91e61'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:38:00 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-39be50f7-99dd-4f2b-aff6-7ffee3d879cf tempest-GroupSnapshotsTest-729188743 None] group_snapshot 22b3f345-7936-4214-8b6e-c10d2e1c8c0f: deleted successfully Jul 06 15:38:01 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9e444869-d509-4c76-a9fd-df9c1d159274 tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "cinder-quobyte-5cf7c167-94dc-4093-be96-90bf808d913a" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:01 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9e444869-d509-4c76-a9fd-df9c1d159274 tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-5cf7c167-94dc-4093-be96-90bf808d913a" acquired by "delete_volume" :: waited 0.029s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:02 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5152eb-254e-48b2-82cb-e0d513045655]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9e444869-d509-4c76-a9fd-df9c1d159274 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:02 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a Jul 06 15:38:02 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:02 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9e444869-d509-4c76-a9fd-df9c1d159274 tempest-GroupSnapshotsTest-729188743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a" returned: 0 in 0.971s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9e444869-d509-4c76-a9fd-df9c1d159274 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:03 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a Jul 06 15:38:03 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:04 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9e444869-d509-4c76-a9fd-df9c1d159274 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5cf7c167-94dc-4093-be96-90bf808d913a" returned: 0 in 1.150s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:04 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9e444869-d509-4c76-a9fd-df9c1d159274 tempest-GroupSnapshotsTest-729188743 None] Lock "cinder-quobyte-5cf7c167-94dc-4093-be96-90bf808d913a" released by "delete_volume" :: held 2.277s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:04 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-9e444869-d509-4c76-a9fd-df9c1d159274 tempest-GroupSnapshotsTest-729188743 None] Created reservations ['08bae0ce-6ca9-4147-9375-9588dd5819a2'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:38:04 devstack cinder-volume[86148]: WARNING cinder.quota [None req-9e444869-d509-4c76-a9fd-df9c1d159274 tempest-GroupSnapshotsTest-729188743 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-746416287 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-746416287, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:38:04 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-9e444869-d509-4c76-a9fd-df9c1d159274 tempest-GroupSnapshotsTest-729188743 None] Created reservations ['5ba099f4-b9f4-4a06-8650-187ff1e384a8', 'c69f602c-aa70-4c99-ae3e-fb54ee3494bb', '24977871-de2a-4706-85ec-d66b311859b9', '5295d077-558b-4613-a28a-334eb3712eff'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:38:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9e444869-d509-4c76-a9fd-df9c1d159274 tempest-GroupSnapshotsTest-729188743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9e444869-d509-4c76-a9fd-df9c1d159274 tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:04 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-9e444869-d509-4c76-a9fd-df9c1d159274 tempest-GroupSnapshotsTest-729188743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:04 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-9e444869-d509-4c76-a9fd-df9c1d159274 tempest-GroupSnapshotsTest-729188743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9e444869-d509-4c76-a9fd-df9c1d159274 tempest-GroupSnapshotsTest-729188743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9e444869-d509-4c76-a9fd-df9c1d159274 tempest-GroupSnapshotsTest-729188743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:04 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:38:04 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:05 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:05 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-20457414-8f14-4ef8-9325-0f0150262535 tempest-TestStampPattern-150571277 None] Acquiring lock "cinder-5c568390-9d78-48fe-845c-2f90ff72701b-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9e444869-d509-4c76-a9fd-df9c1d159274 tempest-GroupSnapshotsTest-729188743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.790s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:05 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-9e444869-d509-4c76-a9fd-df9c1d159274 tempest-GroupSnapshotsTest-729188743 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:38:05 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-9e444869-d509-4c76-a9fd-df9c1d159274 tempest-GroupSnapshotsTest-729188743 None] Delete group completed successfully. Jul 06 15:38:05 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-20457414-8f14-4ef8-9325-0f0150262535 tempest-TestStampPattern-150571277 None] Lock "cinder-5c568390-9d78-48fe-845c-2f90ff72701b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:05 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-20457414-8f14-4ef8-9325-0f0150262535 tempest-TestStampPattern-150571277 None] Acquiring lock "cinder-quobyte-5c568390-9d78-48fe-845c-2f90ff72701b" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:05 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-20457414-8f14-4ef8-9325-0f0150262535 tempest-TestStampPattern-150571277 None] Lock "cinder-quobyte-5c568390-9d78-48fe-845c-2f90ff72701b" acquired by "delete_volume" :: waited 0.022s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:05 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[1684c50c-304d-4c5b-a48d-1938aad9639d]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-20457414-8f14-4ef8-9325-0f0150262535 tempest-TestStampPattern-150571277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:05 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b Jul 06 15:38:05 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:06 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-20457414-8f14-4ef8-9325-0f0150262535 tempest-TestStampPattern-150571277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b" returned: 0 in 0.959s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-20457414-8f14-4ef8-9325-0f0150262535 tempest-TestStampPattern-150571277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:06 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b Jul 06 15:38:06 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:07 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-20457414-8f14-4ef8-9325-0f0150262535 tempest-TestStampPattern-150571277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5c568390-9d78-48fe-845c-2f90ff72701b" returned: 0 in 0.721s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:07 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-20457414-8f14-4ef8-9325-0f0150262535 tempest-TestStampPattern-150571277 None] Lock "cinder-quobyte-5c568390-9d78-48fe-845c-2f90ff72701b" released by "delete_volume" :: held 1.808s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:07 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-20457414-8f14-4ef8-9325-0f0150262535 tempest-TestStampPattern-150571277 None] Created reservations ['19b288ba-71aa-478a-af39-d0d9aad0b045', '2c1f11ec-8304-4596-8efd-8d45b87e2054', '58f206f7-1b4a-4734-9a5f-3e3c0e198be0', '3eb461b3-1393-4a08-af16-ac52af5889e9'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:38:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-20457414-8f14-4ef8-9325-0f0150262535 tempest-TestStampPattern-150571277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-20457414-8f14-4ef8-9325-0f0150262535 tempest-TestStampPattern-150571277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-20457414-8f14-4ef8-9325-0f0150262535 tempest-TestStampPattern-150571277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-20457414-8f14-4ef8-9325-0f0150262535 tempest-TestStampPattern-150571277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-20457414-8f14-4ef8-9325-0f0150262535 tempest-TestStampPattern-150571277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-20457414-8f14-4ef8-9325-0f0150262535 tempest-TestStampPattern-150571277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:07 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:38:07 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:08 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-20457414-8f14-4ef8-9325-0f0150262535 tempest-TestStampPattern-150571277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.257s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:08 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-20457414-8f14-4ef8-9325-0f0150262535 tempest-TestStampPattern-150571277 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:38:08 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-20457414-8f14-4ef8-9325-0f0150262535 tempest-TestStampPattern-150571277 None] Deleted volume successfully. Jul 06 15:38:08 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-20457414-8f14-4ef8-9325-0f0150262535 tempest-TestStampPattern-150571277 None] Lock "cinder-5c568390-9d78-48fe-845c-2f90ff72701b-delete_volume" released by "delete_volume" :: held 3.464s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:09 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:38:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Flow 'volume_create_manager' (51e43129-bf4f-4643-8afa-54a0470230dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72fcefd6-ed6c-4315-bd73-0a09a9164fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72fcefd6-ed6c-4315-bd73-0a09a9164fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-89549852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0144b92-8dbd-4d3e-ac95-9356d32968eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='426d2547df6f4d1c81a0f34ba08d6625',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:09Z,use_quota=True,user_id='fc837df5cc324e55b3609b28bb8479ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9a5a262-647e-465c-895c-9de7104b8e33),volume_type_id=a9a5a262-647e-465c-895c-9de7104b8e33)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ad2a87d-4c69-4cbc-b6cf-6b39db5d51ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ad2a87d-4c69-4cbc-b6cf-6b39db5d51ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80410270-b91e-4715-8f9a-51dccfc7f0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80410270-b91e-4715-8f9a-51dccfc7f0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0144b92-8dbd-4d3e-ac95-9356d32968eb', 'volume_name': 'volume-f0144b92-8dbd-4d3e-ac95-9356d32968eb', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e2e9d68-a23e-4700-839d-4e2f0dd8644a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e2e9d68-a23e-4700-839d-4e2f0dd8644a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c24c7f5f-23ec-4e50-a1a1-e9b7c282da65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:09 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Volume f0144b92-8dbd-4d3e-ac95-9356d32968eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0144b92-8dbd-4d3e-ac95-9356d32968eb', 'volume_size': 1} Jul 06 15:38:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-89549852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0144b92-8dbd-4d3e-ac95-9356d32968eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='426d2547df6f4d1c81a0f34ba08d6625',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:09Z,use_quota=True,user_id='fc837df5cc324e55b3609b28bb8479ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9a5a262-647e-465c-895c-9de7104b8e33),volume_type_id=a9a5a262-647e-465c-895c-9de7104b8e33)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:38:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Creating volume f0144b92-8dbd-4d3e-ac95-9356d32968eb {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:38:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:38:09 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:38:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f0144b92-8dbd-4d3e-ac95-9356d32968eb 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:09 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f0144b92-8dbd-4d3e-ac95-9356d32968eb 1073741824 Jul 06 15:38:09 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:09 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:38:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Flow 'volume_create_manager' (57ffd4cc-e452-486a-b733-9d781b60b112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (841744f2-2143-438e-9e48-0e63256bde55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (841744f2-2143-438e-9e48-0e63256bde55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1810851922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aae3b6be-4884-4c0a-bdb4-c30159797430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='426d2547df6f4d1c81a0f34ba08d6625',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:10Z,use_quota=True,user_id='fc837df5cc324e55b3609b28bb8479ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543bdac6-ab5d-4b7e-aed8-1474d3fa59eb),volume_type_id=543bdac6-ab5d-4b7e-aed8-1474d3fa59eb)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b213e9-63d8-4e63-a732-5ac46cda1f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b213e9-63d8-4e63-a732-5ac46cda1f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1307ae73-c85a-4a9f-9a89-0d5a17ca5103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1307ae73-c85a-4a9f-9a89-0d5a17ca5103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aae3b6be-4884-4c0a-bdb4-c30159797430', 'volume_name': 'volume-aae3b6be-4884-4c0a-bdb4-c30159797430', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e0f673c-e07f-44fb-b52f-5c632c10fc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e0f673c-e07f-44fb-b52f-5c632c10fc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1933b055-0c54-412d-9e03-23564149a672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:10 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Volume aae3b6be-4884-4c0a-bdb4-c30159797430: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aae3b6be-4884-4c0a-bdb4-c30159797430', 'volume_size': 1} Jul 06 15:38:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:11 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f0144b92-8dbd-4d3e-ac95-9356d32968eb 1073741824" returned: 0 in 1.823s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f0144b92-8dbd-4d3e-ac95-9356d32968eb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:11 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f0144b92-8dbd-4d3e-ac95-9356d32968eb Jul 06 15:38:11 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:11 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:38:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Flow 'volume_create_manager' (07078837-0156-4a58-839b-05ee111ea1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (566139e2-07ad-4a09-97ea-991008217423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (566139e2-07ad-4a09-97ea-991008217423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-617026736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf10def9-ad3c-4921-abf3-565e88dc5f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='426d2547df6f4d1c81a0f34ba08d6625',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:12Z,use_quota=True,user_id='fc837df5cc324e55b3609b28bb8479ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c28064d-3b4e-4b7e-817e-fd50fd6a2091),volume_type_id=3c28064d-3b4e-4b7e-817e-fd50fd6a2091)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be5632fe-0755-4720-b709-e110a575d726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be5632fe-0755-4720-b709-e110a575d726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39e315c9-7ed6-48ac-84fe-cd8a77dd04f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:12 devstack cinder-volume[86148]: DEBUG cinder.image.glance [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Creating Keystone auth plugin from conf {{(pid=86148) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 15:38:12 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f0144b92-8dbd-4d3e-ac95-9356d32968eb" returned: 0 in 1.336s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] <== create_volume: return (3227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:38:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.232s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39e315c9-7ed6-48ac-84fe-cd8a77dd04f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cf10def9-ad3c-4921-abf3-565e88dc5f9d', 'volume_name': 'volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d', 'volume_size': 1, 'image_id': 'be816866-9886-437b-9e4e-595e10888d5b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be816866-9886-437b-9e4e-595e10888d5b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1212988867', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '426d2547df6f4d1c81a0f34ba08d6625', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be816866-9886-437b-9e4e-595e10888d5b', 'created_at': datetime.datetime(2026, 7, 6, 13, 38, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 38, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be816866-9886-437b-9e4e-595e10888d5b/file', 'properties': {}}, 'image_service': }' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d99b7a-d062-4fb3-895b-c9b06717789c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d99b7a-d062-4fb3-895b-c9b06717789c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb5292d-c1b2-4c83-9c88-19351e2afc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:12 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Volume cf10def9-ad3c-4921-abf3-565e88dc5f9d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d', 'volume_size': 1, 'image_id': 'be816866-9886-437b-9e4e-595e10888d5b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be816866-9886-437b-9e4e-595e10888d5b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1212988867', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '426d2547df6f4d1c81a0f34ba08d6625', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be816866-9886-437b-9e4e-595e10888d5b', 'created_at': datetime.datetime(2026, 7, 6, 13, 38, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 38, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be816866-9886-437b-9e4e-595e10888d5b/file', 'properties': {}}, 'image_service': } Jul 06 15:38:12 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Trying to clone cf10def9-ad3c-4921-abf3-565e88dc5f9d from image be816866-9886-437b-9e4e-595e10888d5b at location (None, [{'url': 'file:///opt/stack/data/glance/images/be816866-9886-437b-9e4e-595e10888d5b', 'metadata': {}}]). {{(pid=86148) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 15:38:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.572s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1810851922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aae3b6be-4884-4c0a-bdb4-c30159797430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='426d2547df6f4d1c81a0f34ba08d6625',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:10Z,use_quota=True,user_id='fc837df5cc324e55b3609b28bb8479ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543bdac6-ab5d-4b7e-aed8-1474d3fa59eb),volume_type_id=543bdac6-ab5d-4b7e-aed8-1474d3fa59eb)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:38:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Creating volume aae3b6be-4884-4c0a-bdb4-c30159797430 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:38:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:38:12 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:38:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-aae3b6be-4884-4c0a-bdb4-c30159797430 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:12 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-b1a38c2a-2169-4a56-955f-d2fcb3d73e4b tempest-GroupsV320Test-969561123 None] Group tempest-GroupsV320Test-Group-2095542418: creating Jul 06 15:38:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c24c7f5f-23ec-4e50-a1a1-e9b7c282da65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0144b92-8dbd-4d3e-ac95-9356d32968eb', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:12 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-aae3b6be-4884-4c0a-bdb4-c30159797430 1073741824 Jul 06 15:38:12 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db48a80a-f2c0-4fb1-a184-4182a84e4535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:12 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-b1a38c2a-2169-4a56-955f-d2fcb3d73e4b tempest-GroupsV320Test-969561123 None] Group tempest-GroupsV320Test-Group-2095542418: created successfully Jul 06 15:38:12 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Volume volume-f0144b92-8dbd-4d3e-ac95-9356d32968eb (f0144b92-8dbd-4d3e-ac95-9356d32968eb): created successfully Jul 06 15:38:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db48a80a-f2c0-4fb1-a184-4182a84e4535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Flow 'volume_create_manager' (51e43129-bf4f-4643-8afa-54a0470230dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:12 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-b1a38c2a-2169-4a56-955f-d2fcb3d73e4b tempest-GroupsV320Test-969561123 None] Create group completed successfully. Jul 06 15:38:12 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-b0dd74af-1433-4555-b07b-7d7586d7cb13 tempest-TestInstancesWithCinderVolumes-396084605 None] Created volume successfully. Jul 06 15:38:13 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-aae3b6be-4884-4c0a-bdb4-c30159797430 1073741824" returned: 0 in 1.157s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-aae3b6be-4884-4c0a-bdb4-c30159797430 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:13 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-aae3b6be-4884-4c0a-bdb4-c30159797430 Jul 06 15:38:13 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:14 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-6e1149e3-58cf-4ae1-8182-6b423cf68a46 tempest-GroupsV320Test-969561123 None] Created reservations ['eb9d2fbc-0f5e-40d7-bef3-9b1b1e9981f3'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:38:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6e1149e3-58cf-4ae1-8182-6b423cf68a46 tempest-GroupsV320Test-969561123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6e1149e3-58cf-4ae1-8182-6b423cf68a46 tempest-GroupsV320Test-969561123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6e1149e3-58cf-4ae1-8182-6b423cf68a46 tempest-GroupsV320Test-969561123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6e1149e3-58cf-4ae1-8182-6b423cf68a46 tempest-GroupsV320Test-969561123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6e1149e3-58cf-4ae1-8182-6b423cf68a46 tempest-GroupsV320Test-969561123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6e1149e3-58cf-4ae1-8182-6b423cf68a46 tempest-GroupsV320Test-969561123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:14 devstack sudo[99793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:38:14 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:14 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-aae3b6be-4884-4c0a-bdb4-c30159797430" returned: 0 in 1.017s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] <== create_volume: return (2252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:38:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.255s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1933b055-0c54-412d-9e03-23564149a672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aae3b6be-4884-4c0a-bdb4-c30159797430', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ffb0f6a-0f41-490f-b3f0-9779074f9877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:14 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Volume volume-aae3b6be-4884-4c0a-bdb4-c30159797430 (aae3b6be-4884-4c0a-bdb4-c30159797430): created successfully Jul 06 15:38:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ffb0f6a-0f41-490f-b3f0-9779074f9877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Flow 'volume_create_manager' (57ffd4cc-e452-486a-b733-9d781b60b112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:15 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-5986a3e6-d916-4283-99a1-b1a6d8885252 tempest-TestInstancesWithCinderVolumes-396084605 None] Created volume successfully. Jul 06 15:38:15 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6e1149e3-58cf-4ae1-8182-6b423cf68a46 tempest-GroupsV320Test-969561123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.191s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:15 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-6e1149e3-58cf-4ae1-8182-6b423cf68a46 tempest-GroupsV320Test-969561123 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:38:16 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-6e1149e3-58cf-4ae1-8182-6b423cf68a46 tempest-GroupsV320Test-969561123 None] Delete group completed successfully. Jul 06 15:38:17 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_be816866-9886-437b-9e4e-595e10888d5b_7aj6fm2_devstack@QuobyteHD, size 20.69 MB, duration 4.89 sec {{(pid=86148) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 15:38:17 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Image download 20.69 MB at 4.23 MB/s Jul 06 15:38:17 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[739f0ac3-e75d-42e2-9967-04e9d4e2dd14]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be816866-9886-437b-9e4e-595e10888d5b_7aj6fm2_devstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:17 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be816866-9886-437b-9e4e-595e10888d5b_7aj6fm2_devstack@QuobyteHD Jul 06 15:38:17 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:18 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be816866-9886-437b-9e4e-595e10888d5b_7aj6fm2_devstack@QuobyteHD" returned: 0 in 1.092s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:18 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Temporary image be816866-9886-437b-9e4e-595e10888d5b is fetched for user fc837df5cc324e55b3609b28bb8479ba. {{(pid=86148) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 15:38:18 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[16faa00d-7c8a-4c67-8244-9615597416f8]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be816866-9886-437b-9e4e-595e10888d5b_7aj6fm2_devstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:18 devstack sudo[99805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be816866-9886-437b-9e4e-595e10888d5b_7aj6fm2_devstack@QuobyteHD Jul 06 15:38:18 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:19 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be816866-9886-437b-9e4e-595e10888d5b_7aj6fm2_devstack@QuobyteHD" returned: 0 in 1.076s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:19 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-617026736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf10def9-ad3c-4921-abf3-565e88dc5f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='426d2547df6f4d1c81a0f34ba08d6625',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:12Z,use_quota=True,user_id='fc837df5cc324e55b3609b28bb8479ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c28064d-3b4e-4b7e-817e-fd50fd6a2091),volume_type_id=3c28064d-3b4e-4b7e-817e-fd50fd6a2091)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:38:19 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Creating volume cf10def9-ad3c-4921-abf3-565e88dc5f9d {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:38:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:19 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:19 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:19 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:38:19 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:38:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:19 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d 1073741824 Jul 06 15:38:19 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:21 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d 1073741824" returned: 0 in 1.211s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:21 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d Jul 06 15:38:21 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:21 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d" returned: 0 in 0.863s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] <== create_volume: return (2123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:38:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.129s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:22 devstack cinder-volume[86148]: DEBUG cinder.volume.volume_utils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Attempting download of be816866-9886-437b-9e4e-595e10888d5b ((None, [{'url': 'file:///opt/stack/data/glance/images/be816866-9886-437b-9e4e-595e10888d5b', 'metadata': {}}])) to volume cf10def9-ad3c-4921-abf3-565e88dc5f9d. {{(pid=86148) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 15:38:22 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f49f88-a2ac-488e-9061-8d76f6a0decf]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be816866-9886-437b-9e4e-595e10888d5b_0h652k98 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:22 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be816866-9886-437b-9e4e-595e10888d5b_0h652k98 Jul 06 15:38:22 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:22 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be816866-9886-437b-9e4e-595e10888d5b_0h652k98" returned: 0 in 0.873s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be816866-9886-437b-9e4e-595e10888d5b_0h652k98 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:23 devstack sudo[99839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be816866-9886-437b-9e4e-595e10888d5b_0h652k98 Jul 06 15:38:23 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:23 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be816866-9886-437b-9e4e-595e10888d5b_0h652k98" returned: 1 in 0.786s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be816866-9886-437b-9e4e-595e10888d5b_0h652k98' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:38:23 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[e502bb43-c7a9-4db8-9acd-02f05c9f7966]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be816866-9886-437b-9e4e-595e10888d5b_7aj6fm2_devstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:23 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be816866-9886-437b-9e4e-595e10888d5b_7aj6fm2_devstack@QuobyteHD Jul 06 15:38:23 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:24 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be816866-9886-437b-9e4e-595e10888d5b_7aj6fm2_devstack@QuobyteHD" returned: 0 in 0.833s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:24 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] be816866-9886-437b-9e4e-595e10888d5b was qcow2, converting to raw {{(pid=86148) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 15:38:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be816866-9886-437b-9e4e-595e10888d5b_7aj6fm2_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:24 devstack sudo[99848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be816866-9886-437b-9e4e-595e10888d5b_7aj6fm2_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d Jul 06 15:38:24 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:26 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be816866-9886-437b-9e4e-595e10888d5b_7aj6fm2_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d" returned: 0 in 2.056s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:26 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_be816866-9886-437b-9e4e-595e10888d5b_7aj6fm2_devstack@QuobyteHD, size 112.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d {{(pid=86148) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:38:26 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Converted 112.00 MB image at 54.45 MB/s Jul 06 15:38:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:26 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d 1G Jul 06 15:38:26 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:27 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d 1G" returned: 0 in 0.728s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:27 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[90510570-7d54-436d-840a-b77eb65010bb]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:27 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d Jul 06 15:38:27 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:28 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d" returned: 0 in 0.859s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:28 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d Jul 06 15:38:28 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:29 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:38:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Flow 'volume_create_manager' (08121309-26b4-45bc-964e-0b2807064867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76c2239-7b16-407b-893b-82c360d3ce8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76c2239-7b16-407b-893b-82c360d3ce8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9062926f-b361-4a28-a961-e9680184993f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='104131f5702a40969290b472ac4f0a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:29Z,use_quota=True,user_id='45bda5db6132444895512c3eb12c468b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b3943ea-f037-4e30-88de-e5f163f175e3),volume_type_id=3b3943ea-f037-4e30-88de-e5f163f175e3)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b988ce7e-b752-493a-bb74-35617c22130f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b988ce7e-b752-493a-bb74-35617c22130f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f957c99-1690-43c2-81e3-382bbe6a268a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:29 devstack cinder-volume[86148]: DEBUG cinder.image.glance [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Creating Keystone auth plugin from conf {{(pid=86148) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 15:38:29 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d" returned: 1 in 0.925s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:38:29 devstack cinder-volume[86148]: DEBUG cinder.volume.volume_utils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Downloaded image be816866-9886-437b-9e4e-595e10888d5b ((None, [{'url': 'file:///opt/stack/data/glance/images/be816866-9886-437b-9e4e-595e10888d5b', 'metadata': {}}])) to volume cf10def9-ad3c-4921-abf3-565e88dc5f9d successfully. {{(pid=86148) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 15:38:29 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Temporary image be816866-9886-437b-9e4e-595e10888d5b for user fc837df5cc324e55b3609b28bb8479ba is deleted. {{(pid=86148) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 15:38:29 devstack cinder-volume[86148]: DEBUG cinder.volume.volume_utils [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Marking volume cf10def9-ad3c-4921-abf3-565e88dc5f9d as bootable. {{(pid=86148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 15:38:29 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Copying metadata from image be816866-9886-437b-9e4e-595e10888d5b to cf10def9-ad3c-4921-abf3-565e88dc5f9d. {{(pid=86148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 15:38:29 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Creating volume glance metadata for volume cf10def9-ad3c-4921-abf3-565e88dc5f9d backed by image be816866-9886-437b-9e4e-595e10888d5b with: {'image_id': 'be816866-9886-437b-9e4e-595e10888d5b', 'image_name': 'tempest-scenario-img--1212988867', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86148) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 15:38:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb5292d-c1b2-4c83-9c88-19351e2afc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d', 'volume_size': 1, 'image_id': 'be816866-9886-437b-9e4e-595e10888d5b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be816866-9886-437b-9e4e-595e10888d5b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1212988867', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '426d2547df6f4d1c81a0f34ba08d6625', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be816866-9886-437b-9e4e-595e10888d5b', 'created_at': datetime.datetime(2026, 7, 6, 13, 38, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 38, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be816866-9886-437b-9e4e-595e10888d5b/file', 'properties': {}}, 'image_service': }' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12071881-3b2e-4d5b-a3ba-39a823779ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:29 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Volume volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d (cf10def9-ad3c-4921-abf3-565e88dc5f9d): created successfully Jul 06 15:38:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12071881-3b2e-4d5b-a3ba-39a823779ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Flow 'volume_create_manager' (07078837-0156-4a58-839b-05ee111ea1b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:29 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a376358c-d068-4f55-b561-2f76c57c81f3 tempest-TestInstancesWithCinderVolumes-396084605 None] Created volume successfully. Jul 06 15:38:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f957c99-1690-43c2-81e3-382bbe6a268a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9062926f-b361-4a28-a961-e9680184993f', 'volume_name': 'volume-9062926f-b361-4a28-a961-e9680184993f', 'volume_size': 1, 'image_id': '957487a4-982e-4b21-9f5c-f73c04ff3386', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/957487a4-982e-4b21-9f5c-f73c04ff3386', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '968d2c5cc32a9798eef0e61adf7330ab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '104131f5702a40969290b472ac4f0a30', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4a42cca704f7ce8f5d56908ce5c9f42caa13fbd714f9e566afd864738c6e8f45d0706f5b5d6d1b8114b62b4853ec5ad52ced9a01107abbd2b8ac94216140e28f', 'id': '957487a4-982e-4b21-9f5c-f73c04ff3386', 'created_at': datetime.datetime(2026, 7, 6, 13, 38, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 38, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/957487a4-982e-4b21-9f5c-f73c04ff3386/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068e0fc8-6cc7-4286-b043-ffec699655a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068e0fc8-6cc7-4286-b043-ffec699655a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678ade49-b67d-4c8b-a981-3ce3a7589c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:29 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Volume 9062926f-b361-4a28-a961-e9680184993f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9062926f-b361-4a28-a961-e9680184993f', 'volume_size': 1, 'image_id': '957487a4-982e-4b21-9f5c-f73c04ff3386', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/957487a4-982e-4b21-9f5c-f73c04ff3386', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '968d2c5cc32a9798eef0e61adf7330ab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '104131f5702a40969290b472ac4f0a30', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4a42cca704f7ce8f5d56908ce5c9f42caa13fbd714f9e566afd864738c6e8f45d0706f5b5d6d1b8114b62b4853ec5ad52ced9a01107abbd2b8ac94216140e28f', 'id': '957487a4-982e-4b21-9f5c-f73c04ff3386', 'created_at': datetime.datetime(2026, 7, 6, 13, 38, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 38, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/957487a4-982e-4b21-9f5c-f73c04ff3386/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 06 15:38:29 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Trying to clone 9062926f-b361-4a28-a961-e9680184993f from image 957487a4-982e-4b21-9f5c-f73c04ff3386 at location (None, [{'url': 'file:///opt/stack/data/glance/images/957487a4-982e-4b21-9f5c-f73c04ff3386', 'metadata': {}}]). {{(pid=86148) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 15:38:29 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_957487a4-982e-4b21-9f5c-f73c04ff3386_j2v9287hdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86148) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 15:38:29 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Image download 0.00 MB at 0.00 MB/s Jul 06 15:38:30 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a786fe0-ed24-4353-992b-cacb4b9dc0c7]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_957487a4-982e-4b21-9f5c-f73c04ff3386_j2v9287hdevstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:30 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_957487a4-982e-4b21-9f5c-f73c04ff3386_j2v9287hdevstack@QuobyteHD Jul 06 15:38:30 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:31 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_957487a4-982e-4b21-9f5c-f73c04ff3386_j2v9287hdevstack@QuobyteHD" returned: 0 in 0.983s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_957487a4-982e-4b21-9f5c-f73c04ff3386_j2v9287hdevstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:31 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_957487a4-982e-4b21-9f5c-f73c04ff3386_j2v9287hdevstack@QuobyteHD Jul 06 15:38:31 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:32 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_957487a4-982e-4b21-9f5c-f73c04ff3386_j2v9287hdevstack@QuobyteHD" returned: 1 in 1.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_957487a4-982e-4b21-9f5c-f73c04ff3386_j2v9287hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:38:32 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Temporary image 957487a4-982e-4b21-9f5c-f73c04ff3386 is fetched for user 45bda5db6132444895512c3eb12c468b. {{(pid=86148) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 15:38:32 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[314db00b-7004-452e-86c1-d7a8f6a8c732]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_957487a4-982e-4b21-9f5c-f73c04ff3386_j2v9287hdevstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:32 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_957487a4-982e-4b21-9f5c-f73c04ff3386_j2v9287hdevstack@QuobyteHD Jul 06 15:38:32 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:33 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_957487a4-982e-4b21-9f5c-f73c04ff3386_j2v9287hdevstack@QuobyteHD" returned: 0 in 1.057s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_957487a4-982e-4b21-9f5c-f73c04ff3386_j2v9287hdevstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:33 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_957487a4-982e-4b21-9f5c-f73c04ff3386_j2v9287hdevstack@QuobyteHD Jul 06 15:38:33 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:34 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_957487a4-982e-4b21-9f5c-f73c04ff3386_j2v9287hdevstack@QuobyteHD" returned: 1 in 0.786s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_957487a4-982e-4b21-9f5c-f73c04ff3386_j2v9287hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:38:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9062926f-b361-4a28-a961-e9680184993f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='104131f5702a40969290b472ac4f0a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:29Z,use_quota=True,user_id='45bda5db6132444895512c3eb12c468b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b3943ea-f037-4e30-88de-e5f163f175e3),volume_type_id=3b3943ea-f037-4e30-88de-e5f163f175e3)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:38:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Creating volume 9062926f-b361-4a28-a961-e9680184993f {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:38:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:38:34 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:38:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:34 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f 1073741824 Jul 06 15:38:34 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:34 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-6ccc48c3-7588-40a6-bf44-afe7a0d677e8 req-050f30c1-aa33-4bf8-af43-737775d03ca8 tempest-TestMinimumBasicScenario-523968004 None] Terminate volume connection completed successfully. Jul 06 15:38:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-6ccc48c3-7588-40a6-bf44-afe7a0d677e8 req-050f30c1-aa33-4bf8-af43-737775d03ca8 tempest-TestMinimumBasicScenario-523968004 None] Deleting attachment 302f80c3-945d-4deb-a2ae-de970364f700. {{(pid=86148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:38:35 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f 1073741824" returned: 0 in 1.044s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:35 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f Jul 06 15:38:35 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:35 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f" returned: 0 in 0.707s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:35 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:38:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:35 devstack cinder-volume[86148]: DEBUG cinder.volume.volume_utils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Attempting download of 957487a4-982e-4b21-9f5c-f73c04ff3386 ((None, [{'url': 'file:///opt/stack/data/glance/images/957487a4-982e-4b21-9f5c-f73c04ff3386', 'metadata': {}}])) to volume 9062926f-b361-4a28-a961-e9680184993f. {{(pid=86148) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 15:38:35 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[64158265-1dbd-4ddb-965a-0b3b313a1539]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_957487a4-982e-4b21-9f5c-f73c04ff3386_aluotdis {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:36 devstack sudo[99914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_957487a4-982e-4b21-9f5c-f73c04ff3386_aluotdis Jul 06 15:38:36 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:36 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-69125e98-bee0-4d6c-83c9-b925246347b8 tempest-TestMinimumBasicScenario-523968004 None] Acquiring lock "cinder-f28b212f-ce36-4786-8ebd-c4cec70d0a44-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_957487a4-982e-4b21-9f5c-f73c04ff3386_aluotdis" returned: 0 in 0.910s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_957487a4-982e-4b21-9f5c-f73c04ff3386_aluotdis {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-69125e98-bee0-4d6c-83c9-b925246347b8 tempest-TestMinimumBasicScenario-523968004 None] Lock "cinder-f28b212f-ce36-4786-8ebd-c4cec70d0a44-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:36 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=92,cinder:INSERT=32,cinder:UPDATE=96,cinder:DELETE=3 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:38:36 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=89,cinder:INSERT=23,cinder:UPDATE=90,cinder:DELETE=3 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:38:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-69125e98-bee0-4d6c-83c9-b925246347b8 tempest-TestMinimumBasicScenario-523968004 None] Acquiring lock "cinder-quobyte-f28b212f-ce36-4786-8ebd-c4cec70d0a44" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-69125e98-bee0-4d6c-83c9-b925246347b8 tempest-TestMinimumBasicScenario-523968004 None] Lock "cinder-quobyte-f28b212f-ce36-4786-8ebd-c4cec70d0a44" acquired by "delete_volume" :: waited 0.038s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:37 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_957487a4-982e-4b21-9f5c-f73c04ff3386_aluotdis Jul 06 15:38:37 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:37 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[596b7e9d-2b68-40bb-89e0-aace590db4c9]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-69125e98-bee0-4d6c-83c9-b925246347b8 tempest-TestMinimumBasicScenario-523968004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f28b212f-ce36-4786-8ebd-c4cec70d0a44 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:37 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f28b212f-ce36-4786-8ebd-c4cec70d0a44 Jul 06 15:38:37 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:37 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_957487a4-982e-4b21-9f5c-f73c04ff3386_aluotdis" returned: 1 in 1.038s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_957487a4-982e-4b21-9f5c-f73c04ff3386_aluotdis' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:38:37 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[8decc4e9-1498-45a2-9e78-798a938a0d47]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_957487a4-982e-4b21-9f5c-f73c04ff3386_j2v9287hdevstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:37 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_957487a4-982e-4b21-9f5c-f73c04ff3386_j2v9287hdevstack@QuobyteHD Jul 06 15:38:37 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:38 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-69125e98-bee0-4d6c-83c9-b925246347b8 tempest-TestMinimumBasicScenario-523968004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f28b212f-ce36-4786-8ebd-c4cec70d0a44" returned: 0 in 1.194s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-69125e98-bee0-4d6c-83c9-b925246347b8 tempest-TestMinimumBasicScenario-523968004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f28b212f-ce36-4786-8ebd-c4cec70d0a44 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:38 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f28b212f-ce36-4786-8ebd-c4cec70d0a44 Jul 06 15:38:38 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:38:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:38 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:38:38 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-d1672a8c-8188-43e7-ae63-712525236e96 req-f639bcf8-36ba-4f4d-9be7-a162129c1690 tempest-TestInstancesWithCinderVolumes-396084605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-d1672a8c-8188-43e7-ae63-712525236e96 req-f639bcf8-36ba-4f4d-9be7-a162129c1690 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:38 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d93e61-7308-49a8-8a6b-d2fc887b3d7a]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-d1672a8c-8188-43e7-ae63-712525236e96 req-f639bcf8-36ba-4f4d-9be7-a162129c1690 tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:38 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_957487a4-982e-4b21-9f5c-f73c04ff3386_j2v9287hdevstack@QuobyteHD" returned: 0 in 0.876s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_957487a4-982e-4b21-9f5c-f73c04ff3386_j2v9287hdevstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:38 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d Jul 06 15:38:38 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:38 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_957487a4-982e-4b21-9f5c-f73c04ff3386_j2v9287hdevstack@QuobyteHD Jul 06 15:38:38 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:39 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-69125e98-bee0-4d6c-83c9-b925246347b8 tempest-TestMinimumBasicScenario-523968004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f28b212f-ce36-4786-8ebd-c4cec70d0a44" returned: 0 in 1.285s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:39 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-69125e98-bee0-4d6c-83c9-b925246347b8 tempest-TestMinimumBasicScenario-523968004 None] Lock "cinder-quobyte-f28b212f-ce36-4786-8ebd-c4cec70d0a44" released by "delete_volume" :: held 2.544s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:39 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.141s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:38:39 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager._thread_info {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:38:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread count: 28 {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:38:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread info: [<_MainThread(MainThread, started 124857273856128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:38:39 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-69125e98-bee0-4d6c-83c9-b925246347b8 tempest-TestMinimumBasicScenario-523968004 None] Created reservations ['0388ce8a-83ed-4ba4-a05c-acd3a801cf45', '6c9eefa6-eb14-4f76-8964-3c830acdd3b0', '917993f6-cdb4-40a4-9ab7-a19eb1c62e6f', '7e317836-57be-4419-805c-527bc2dfa91b'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:38:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-69125e98-bee0-4d6c-83c9-b925246347b8 tempest-TestMinimumBasicScenario-523968004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-69125e98-bee0-4d6c-83c9-b925246347b8 tempest-TestMinimumBasicScenario-523968004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:39 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-69125e98-bee0-4d6c-83c9-b925246347b8 tempest-TestMinimumBasicScenario-523968004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:39 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-69125e98-bee0-4d6c-83c9-b925246347b8 tempest-TestMinimumBasicScenario-523968004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-69125e98-bee0-4d6c-83c9-b925246347b8 tempest-TestMinimumBasicScenario-523968004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-69125e98-bee0-4d6c-83c9-b925246347b8 tempest-TestMinimumBasicScenario-523968004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:39 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_957487a4-982e-4b21-9f5c-f73c04ff3386_j2v9287hdevstack@QuobyteHD" returned: 1 in 1.061s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_957487a4-982e-4b21-9f5c-f73c04ff3386_j2v9287hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:38:39 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] 957487a4-982e-4b21-9f5c-f73c04ff3386 was raw, converting to raw {{(pid=86148) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 15:38:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_957487a4-982e-4b21-9f5c-f73c04ff3386_j2v9287hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:39 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:38:39 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:39 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_957487a4-982e-4b21-9f5c-f73c04ff3386_j2v9287hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f Jul 06 15:38:39 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:40 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-d1672a8c-8188-43e7-ae63-712525236e96 req-f639bcf8-36ba-4f4d-9be7-a162129c1690 tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d" returned: 0 in 1.413s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-d1672a8c-8188-43e7-ae63-712525236e96 req-f639bcf8-36ba-4f4d-9be7-a162129c1690 tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:40 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d Jul 06 15:38:40 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:40 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_957487a4-982e-4b21-9f5c-f73c04ff3386_j2v9287hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f" returned: 0 in 0.950s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:40 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_957487a4-982e-4b21-9f5c-f73c04ff3386_j2v9287hdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f {{(pid=86148) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:38:40 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 15:38:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:40 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f 1G Jul 06 15:38:40 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:40 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-69125e98-bee0-4d6c-83c9-b925246347b8 tempest-TestMinimumBasicScenario-523968004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.070s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:40 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-69125e98-bee0-4d6c-83c9-b925246347b8 tempest-TestMinimumBasicScenario-523968004 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:38:40 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-69125e98-bee0-4d6c-83c9-b925246347b8 tempest-TestMinimumBasicScenario-523968004 None] Deleted volume successfully. Jul 06 15:38:40 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-69125e98-bee0-4d6c-83c9-b925246347b8 tempest-TestMinimumBasicScenario-523968004 None] Lock "cinder-f28b212f-ce36-4786-8ebd-c4cec70d0a44-delete_volume" released by "delete_volume" :: held 4.046s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:41 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-d1672a8c-8188-43e7-ae63-712525236e96 req-f639bcf8-36ba-4f4d-9be7-a162129c1690 tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d" returned: 1 in 1.256s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-d1672a8c-8188-43e7-ae63-712525236e96 req-f639bcf8-36ba-4f4d-9be7-a162129c1690 tempest-TestInstancesWithCinderVolumes-396084605 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:38:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-d1672a8c-8188-43e7-ae63-712525236e96 req-f639bcf8-36ba-4f4d-9be7-a162129c1690 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.742s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:41 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-d1672a8c-8188-43e7-ae63-712525236e96 req-f639bcf8-36ba-4f4d-9be7-a162129c1690 tempest-TestInstancesWithCinderVolumes-396084605 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce', 'name': 'volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b2751f0-a0fb-4967-bd7b-17a6c35d9381', 'enforce_multipath': True} {{(pid=86148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:38:41 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-d1672a8c-8188-43e7-ae63-712525236e96 req-f639bcf8-36ba-4f4d-9be7-a162129c1690 tempest-TestInstancesWithCinderVolumes-396084605 None] attachment_update completed successfully. Jul 06 15:38:41 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f 1G" returned: 0 in 0.820s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:41 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[385befd3-3a50-4957-b963-63136b28341b]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:41 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f Jul 06 15:38:41 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:42 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:38:42 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Flow 'volume_create_manager' (d228b75b-33aa-4d19-bff0-1813cd4eb077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4ba539-6fe4-4ca1-ab10-2ea8f3aee9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f" returned: 0 in 1.272s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4ba539-6fe4-4ca1-ab10-2ea8f3aee9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1607968502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=932f911a-ab86-42d1-943e-aac488bb2a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='603c9494c2b94b50b3b5d9d7fd04e088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:43Z,use_quota=True,user_id='b1405980a16749458e3aa1a3c6f4019c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7e966dd-b5bc-4bf7-9546-cfad5853998e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7e966dd-b5bc-4bf7-9546-cfad5853998e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd2b90f-3e18-4275-8290-028576a3d57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd2b90f-3e18-4275-8290-028576a3d57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '932f911a-ab86-42d1-943e-aac488bb2a87', 'volume_name': 'volume-932f911a-ab86-42d1-943e-aac488bb2a87', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41072d99-05cd-447d-8271-1d08906b97bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41072d99-05cd-447d-8271-1d08906b97bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fbebd65-67ed-4203-a28d-f02b1146e4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:42 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Volume 932f911a-ab86-42d1-943e-aac488bb2a87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-932f911a-ab86-42d1-943e-aac488bb2a87', 'volume_size': 1} Jul 06 15:38:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:42 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1607968502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=932f911a-ab86-42d1-943e-aac488bb2a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='603c9494c2b94b50b3b5d9d7fd04e088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:43Z,use_quota=True,user_id='b1405980a16749458e3aa1a3c6f4019c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:38:42 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Creating volume 932f911a-ab86-42d1-943e-aac488bb2a87 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:38:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:42 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:42 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:42 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:38:42 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:38:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-932f911a-ab86-42d1-943e-aac488bb2a87 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:43 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-932f911a-ab86-42d1-943e-aac488bb2a87 1073741824 Jul 06 15:38:43 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:43 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f Jul 06 15:38:43 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:43 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f" returned: 1 in 1.080s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:38:43 devstack cinder-volume[86148]: DEBUG cinder.volume.volume_utils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Downloaded image 957487a4-982e-4b21-9f5c-f73c04ff3386 ((None, [{'url': 'file:///opt/stack/data/glance/images/957487a4-982e-4b21-9f5c-f73c04ff3386', 'metadata': {}}])) to volume 9062926f-b361-4a28-a961-e9680184993f successfully. {{(pid=86148) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 15:38:43 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Temporary image 957487a4-982e-4b21-9f5c-f73c04ff3386 for user 45bda5db6132444895512c3eb12c468b is deleted. {{(pid=86148) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 15:38:43 devstack cinder-volume[86148]: DEBUG cinder.volume.volume_utils [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Marking volume 9062926f-b361-4a28-a961-e9680184993f as bootable. {{(pid=86148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 15:38:43 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Copying metadata from image 957487a4-982e-4b21-9f5c-f73c04ff3386 to 9062926f-b361-4a28-a961-e9680184993f. {{(pid=86148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 15:38:43 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Creating volume glance metadata for volume 9062926f-b361-4a28-a961-e9680184993f backed by image 957487a4-982e-4b21-9f5c-f73c04ff3386 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '957487a4-982e-4b21-9f5c-f73c04ff3386', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '968d2c5cc32a9798eef0e61adf7330ab', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86148) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 15:38:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678ade49-b67d-4c8b-a981-3ce3a7589c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9062926f-b361-4a28-a961-e9680184993f', 'volume_size': 1, 'image_id': '957487a4-982e-4b21-9f5c-f73c04ff3386', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/957487a4-982e-4b21-9f5c-f73c04ff3386', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '968d2c5cc32a9798eef0e61adf7330ab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '104131f5702a40969290b472ac4f0a30', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4a42cca704f7ce8f5d56908ce5c9f42caa13fbd714f9e566afd864738c6e8f45d0706f5b5d6d1b8114b62b4853ec5ad52ced9a01107abbd2b8ac94216140e28f', 'id': '957487a4-982e-4b21-9f5c-f73c04ff3386', 'created_at': datetime.datetime(2026, 7, 6, 13, 38, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 38, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/957487a4-982e-4b21-9f5c-f73c04ff3386/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed312a6-e5f9-4660-93b9-a16ab5099710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:44 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Volume volume-9062926f-b361-4a28-a961-e9680184993f (9062926f-b361-4a28-a961-e9680184993f): created successfully Jul 06 15:38:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed312a6-e5f9-4660-93b9-a16ab5099710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:44 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Flow 'volume_create_manager' (08121309-26b4-45bc-964e-0b2807064867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-932f911a-ab86-42d1-943e-aac488bb2a87 1073741824" returned: 0 in 1.116s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:44 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-2377bc71-c2b1-4750-852f-79deb35b292d tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Created volume successfully. Jul 06 15:38:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-932f911a-ab86-42d1-943e-aac488bb2a87 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:44 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-932f911a-ab86-42d1-943e-aac488bb2a87 Jul 06 15:38:44 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b7faea2e-a578-4231-a36d-0549acb63569 tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Acquiring lock "cinder-9062926f-b361-4a28-a961-e9680184993f-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b7faea2e-a578-4231-a36d-0549acb63569 tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Lock "cinder-9062926f-b361-4a28-a961-e9680184993f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b7faea2e-a578-4231-a36d-0549acb63569 tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Acquiring lock "cinder-quobyte-9062926f-b361-4a28-a961-e9680184993f" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b7faea2e-a578-4231-a36d-0549acb63569 tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Lock "cinder-quobyte-9062926f-b361-4a28-a961-e9680184993f" acquired by "delete_volume" :: waited 0.014s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:44 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4a4800-5d4f-4d22-a8d0-f63f2b4b42ce]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b7faea2e-a578-4231-a36d-0549acb63569 tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:44 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f Jul 06 15:38:44 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:44 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-932f911a-ab86-42d1-943e-aac488bb2a87" returned: 0 in 0.692s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:38:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fbebd65-67ed-4203-a28d-f02b1146e4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-932f911a-ab86-42d1-943e-aac488bb2a87', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68546325-300d-46e8-a8de-04fccdb1f1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:44 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Volume volume-932f911a-ab86-42d1-943e-aac488bb2a87 (932f911a-ab86-42d1-943e-aac488bb2a87): created successfully Jul 06 15:38:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68546325-300d-46e8-a8de-04fccdb1f1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Flow 'volume_create_manager' (d228b75b-33aa-4d19-bff0-1813cd4eb077) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:44 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-6558ef55-9c19-40d7-b614-fc5351f16ae3 tempest-VolumesListAdminTestJSON-146291946 None] Created volume successfully. Jul 06 15:38:45 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b7faea2e-a578-4231-a36d-0549acb63569 tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f" returned: 0 in 1.009s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b7faea2e-a578-4231-a36d-0549acb63569 tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:45 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f Jul 06 15:38:45 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:46 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b7faea2e-a578-4231-a36d-0549acb63569 tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f" returned: 1 in 0.814s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b7faea2e-a578-4231-a36d-0549acb63569 tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:38:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b7faea2e-a578-4231-a36d-0549acb63569 tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:46 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f Jul 06 15:38:46 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:46 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:38:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Flow 'volume_create_manager' (968fd154-1777-462e-81b8-1095c16ca1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca5a57f9-112a-4b58-9ad1-7e3a57ab23af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca5a57f9-112a-4b58-9ad1-7e3a57ab23af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1159275878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26226a4f-40bb-4455-89fd-7b74fb431252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='603c9494c2b94b50b3b5d9d7fd04e088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:46Z,use_quota=True,user_id='b1405980a16749458e3aa1a3c6f4019c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3393327-8c96-4bb1-b8b8-fc416e42d932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3393327-8c96-4bb1-b8b8-fc416e42d932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c277c9cc-4c51-4716-ba8e-ea4d718969bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c277c9cc-4c51-4716-ba8e-ea4d718969bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26226a4f-40bb-4455-89fd-7b74fb431252', 'volume_name': 'volume-26226a4f-40bb-4455-89fd-7b74fb431252', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ffd9d3-838a-4b7a-8367-921356cfd8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ffd9d3-838a-4b7a-8367-921356cfd8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8636ba-e2ff-4cee-8923-26556d7dad18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:46 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Volume 26226a4f-40bb-4455-89fd-7b74fb431252: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26226a4f-40bb-4455-89fd-7b74fb431252', 'volume_size': 1} Jul 06 15:38:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1159275878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26226a4f-40bb-4455-89fd-7b74fb431252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='603c9494c2b94b50b3b5d9d7fd04e088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:46Z,use_quota=True,user_id='b1405980a16749458e3aa1a3c6f4019c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:38:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Creating volume 26226a4f-40bb-4455-89fd-7b74fb431252 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:38:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:38:46 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:38:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-26226a4f-40bb-4455-89fd-7b74fb431252 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:46 devstack sudo[100176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-26226a4f-40bb-4455-89fd-7b74fb431252 1073741824 Jul 06 15:38:46 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:46 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b7faea2e-a578-4231-a36d-0549acb63569 tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9062926f-b361-4a28-a961-e9680184993f" returned: 0 in 0.744s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:47 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b7faea2e-a578-4231-a36d-0549acb63569 tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Lock "cinder-quobyte-9062926f-b361-4a28-a961-e9680184993f" released by "delete_volume" :: held 2.636s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:47 devstack cinder-volume[86148]: WARNING cinder.quota [None req-b7faea2e-a578-4231-a36d-0549acb63569 tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:38:47 devstack cinder-volume[86148]: WARNING cinder.quota [None req-b7faea2e-a578-4231-a36d-0549acb63569 tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:38:47 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-b7faea2e-a578-4231-a36d-0549acb63569 tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Created reservations ['d9d5042e-4513-4038-9722-b91b8c8cf9f3', '3bdb3bb9-46b8-45a2-b0e0-c81e994f493e', '020d3114-2a07-4a7b-8c7b-052466cd01f3', '110ce8ba-dbe3-4fa8-bf9d-292ed2f0a888'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:38:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b7faea2e-a578-4231-a36d-0549acb63569 tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b7faea2e-a578-4231-a36d-0549acb63569 tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:47 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b7faea2e-a578-4231-a36d-0549acb63569 tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:47 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b7faea2e-a578-4231-a36d-0549acb63569 tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b7faea2e-a578-4231-a36d-0549acb63569 tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b7faea2e-a578-4231-a36d-0549acb63569 tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:47 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:38:47 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:47 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-26226a4f-40bb-4455-89fd-7b74fb431252 1073741824" returned: 0 in 0.991s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-26226a4f-40bb-4455-89fd-7b74fb431252 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:47 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-26226a4f-40bb-4455-89fd-7b74fb431252 Jul 06 15:38:47 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:48 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b7faea2e-a578-4231-a36d-0549acb63569 tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.028s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:48 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-b7faea2e-a578-4231-a36d-0549acb63569 tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:38:48 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-b7faea2e-a578-4231-a36d-0549acb63569 tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Deleted volume successfully. Jul 06 15:38:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b7faea2e-a578-4231-a36d-0549acb63569 tempest-VolumeAndVolumeTypeFromImageTest-322480772 None] Lock "cinder-9062926f-b361-4a28-a961-e9680184993f-delete_volume" released by "delete_volume" :: held 3.920s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:48 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-26226a4f-40bb-4455-89fd-7b74fb431252" returned: 0 in 1.160s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:48 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] <== create_volume: return (2236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:38:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.239s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8636ba-e2ff-4cee-8923-26556d7dad18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26226a4f-40bb-4455-89fd-7b74fb431252', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb763b4-bc35-459c-a3b8-020421a6db90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:48 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Volume volume-26226a4f-40bb-4455-89fd-7b74fb431252 (26226a4f-40bb-4455-89fd-7b74fb431252): created successfully Jul 06 15:38:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb763b4-bc35-459c-a3b8-020421a6db90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Flow 'volume_create_manager' (968fd154-1777-462e-81b8-1095c16ca1cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:48 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-fead1d53-98ae-4b50-8d9d-234b3f185ae3 tempest-VolumesListAdminTestJSON-146291946 None] Created volume successfully. Jul 06 15:38:50 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:38:50 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Flow 'volume_create_manager' (0b1db287-1736-4cab-a412-897942df6d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:50 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b051e86-50f1-4011-8311-51c4e81b3595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:50 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b051e86-50f1-4011-8311-51c4e81b3595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1967004672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28849298-c9f3-4f2e-9224-3d7b78d881a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='603c9494c2b94b50b3b5d9d7fd04e088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:51Z,use_quota=True,user_id='b1405980a16749458e3aa1a3c6f4019c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:50 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e43f6f-f804-4554-aeb2-427298b93d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:50 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e43f6f-f804-4554-aeb2-427298b93d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:50 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816c6e44-982c-4aa8-8c92-d617b2b90c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:50 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816c6e44-982c-4aa8-8c92-d617b2b90c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28849298-c9f3-4f2e-9224-3d7b78d881a2', 'volume_name': 'volume-28849298-c9f3-4f2e-9224-3d7b78d881a2', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:50 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd52abb-675e-4e5c-940e-065e7ef94fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:50 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd52abb-675e-4e5c-940e-065e7ef94fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:50 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ce0d1c-da25-4068-80ff-08e806dbeea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:50 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Volume 28849298-c9f3-4f2e-9224-3d7b78d881a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28849298-c9f3-4f2e-9224-3d7b78d881a2', 'volume_size': 1} Jul 06 15:38:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:50 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1967004672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28849298-c9f3-4f2e-9224-3d7b78d881a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='603c9494c2b94b50b3b5d9d7fd04e088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:51Z,use_quota=True,user_id='b1405980a16749458e3aa1a3c6f4019c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:38:50 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Creating volume 28849298-c9f3-4f2e-9224-3d7b78d881a2 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:38:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:50 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:50 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:50 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:38:50 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:38:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-28849298-c9f3-4f2e-9224-3d7b78d881a2 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:50 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-28849298-c9f3-4f2e-9224-3d7b78d881a2 1073741824 Jul 06 15:38:50 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:52 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-28849298-c9f3-4f2e-9224-3d7b78d881a2 1073741824" returned: 0 in 1.425s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-28849298-c9f3-4f2e-9224-3d7b78d881a2 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:52 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-28849298-c9f3-4f2e-9224-3d7b78d881a2 Jul 06 15:38:52 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:53 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-28849298-c9f3-4f2e-9224-3d7b78d881a2" returned: 0 in 1.304s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:53 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] <== create_volume: return (2843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:38:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.845s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ce0d1c-da25-4068-80ff-08e806dbeea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28849298-c9f3-4f2e-9224-3d7b78d881a2', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (148435ac-07f2-43ba-86fe-73e91f2ec0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:53 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Volume volume-28849298-c9f3-4f2e-9224-3d7b78d881a2 (28849298-c9f3-4f2e-9224-3d7b78d881a2): created successfully Jul 06 15:38:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (148435ac-07f2-43ba-86fe-73e91f2ec0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Flow 'volume_create_manager' (0b1db287-1736-4cab-a412-897942df6d82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:53 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-f2cb1bea-a773-497f-9317-40d8775f403c tempest-VolumesListAdminTestJSON-146291946 None] Created volume successfully. Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Flow 'volume_create_manager' (568ac624-26f1-42ab-9eff-a929a3e5e80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1cfaca6-a339-46f0-8d29-5da115373427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1cfaca6-a339-46f0-8d29-5da115373427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-763222700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45290403-7e8a-4d55-8f79-2b415cdede13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f8cb0bfd2d4796808cba9f8fd325c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:56Z,use_quota=True,user_id='bc830f50823d4d4aa00e17874f8987a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97cf69e7-dd6b-4b41-ac3f-aa9a7bfaa74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97cf69e7-dd6b-4b41-ac3f-aa9a7bfaa74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed3601f8-d3f2-468f-b69a-1ac9a4c22252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed3601f8-d3f2-468f-b69a-1ac9a4c22252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45290403-7e8a-4d55-8f79-2b415cdede13', 'volume_name': 'volume-45290403-7e8a-4d55-8f79-2b415cdede13', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab18877f-731f-419b-8c60-9911145ecd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab18877f-731f-419b-8c60-9911145ecd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5637dca3-7610-4326-baa1-e88caab103e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:56 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Volume 45290403-7e8a-4d55-8f79-2b415cdede13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45290403-7e8a-4d55-8f79-2b415cdede13', 'volume_size': 1} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-763222700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45290403-7e8a-4d55-8f79-2b415cdede13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f8cb0bfd2d4796808cba9f8fd325c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:56Z,use_quota=True,user_id='bc830f50823d4d4aa00e17874f8987a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Creating volume 45290403-7e8a-4d55-8f79-2b415cdede13 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:38:56 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-45290403-7e8a-4d55-8f79-2b415cdede13 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:56 devstack sudo[100545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-45290403-7e8a-4d55-8f79-2b415cdede13 1073741824 Jul 06 15:38:56 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Flow 'volume_create_manager' (fce320e1-147a-4ac1-a999-579955c962db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f334799c-205e-4a5f-a6ab-67f4baa34bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f334799c-205e-4a5f-a6ab-67f4baa34bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe3c446-19bd-4518-9e0c-fac7fca59df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='852ae91ce55d4725913a45a8d2b868a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:56Z,use_quota=True,user_id='1a3505d1476447f1be0e64745e600105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e59ca40b-78f8-4b48-8723-eaba023d2f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e59ca40b-78f8-4b48-8723-eaba023d2f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68374946-4df3-4b53-8cb5-ae91ff3b4845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68374946-4df3-4b53-8cb5-ae91ff3b4845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afe3c446-19bd-4518-9e0c-fac7fca59df6', 'volume_name': 'volume-afe3c446-19bd-4518-9e0c-fac7fca59df6', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2533156f-c237-41c4-84b3-59b49a544432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2533156f-c237-41c4-84b3-59b49a544432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fc2e725-aafd-4ab1-8ef2-77dd1db318dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:56 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Volume afe3c446-19bd-4518-9e0c-fac7fca59df6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afe3c446-19bd-4518-9e0c-fac7fca59df6', 'volume_size': 1} Jul 06 15:38:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:57 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-45290403-7e8a-4d55-8f79-2b415cdede13 1073741824" returned: 0 in 1.340s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-45290403-7e8a-4d55-8f79-2b415cdede13 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:57 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-45290403-7e8a-4d55-8f79-2b415cdede13 Jul 06 15:38:57 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:58 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-45290403-7e8a-4d55-8f79-2b415cdede13" returned: 0 in 0.864s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:58 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] <== create_volume: return (2255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:38:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.258s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.048s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:58 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe3c446-19bd-4518-9e0c-fac7fca59df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='852ae91ce55d4725913a45a8d2b868a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:56Z,use_quota=True,user_id='1a3505d1476447f1be0e64745e600105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:38:58 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Creating volume afe3c446-19bd-4518-9e0c-fac7fca59df6 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:38:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:58 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:58 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:58 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:38:58 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:38:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-afe3c446-19bd-4518-9e0c-fac7fca59df6 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:58 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5637dca3-7610-4326-baa1-e88caab103e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45290403-7e8a-4d55-8f79-2b415cdede13', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:58 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-afe3c446-19bd-4518-9e0c-fac7fca59df6 1073741824 Jul 06 15:38:58 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:58 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc4488d-c914-4d8a-b58a-c7b88ccb42d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:58 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Volume volume-45290403-7e8a-4d55-8f79-2b415cdede13 (45290403-7e8a-4d55-8f79-2b415cdede13): created successfully Jul 06 15:38:58 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc4488d-c914-4d8a-b58a-c7b88ccb42d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:58 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Flow 'volume_create_manager' (568ac624-26f1-42ab-9eff-a929a3e5e80b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:58 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-3eda2d16-9b89-4efd-b6dc-3223bc9cdcf6 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Created volume successfully. Jul 06 15:39:00 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:39:00 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Flow 'volume_create_manager' (5d17886e-457b-4ce1-b14c-f88fa915bc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:00 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05417882-61dc-4592-93ea-f108b3b982ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:00 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05417882-61dc-4592-93ea-f108b3b982ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1604266234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb9de614-0264-4a06-b5f6-37ad799ffff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f8cb0bfd2d4796808cba9f8fd325c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:00Z,use_quota=True,user_id='bc830f50823d4d4aa00e17874f8987a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:00 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed61e9a-6c69-4e8f-9fd9-c41cf8d5cf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:00 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed61e9a-6c69-4e8f-9fd9-c41cf8d5cf66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:00 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (207846db-50ca-4842-94c6-d7cea46c2258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:00 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:00 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (207846db-50ca-4842-94c6-d7cea46c2258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb9de614-0264-4a06-b5f6-37ad799ffff4', 'volume_name': 'volume-bb9de614-0264-4a06-b5f6-37ad799ffff4', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:00 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3e0aea-c857-410b-87bd-743d1a8b3d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:00 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3e0aea-c857-410b-87bd-743d1a8b3d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:00 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a3cf9c-5db5-419e-b900-03bc1e375ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:00 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Volume bb9de614-0264-4a06-b5f6-37ad799ffff4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb9de614-0264-4a06-b5f6-37ad799ffff4', 'volume_size': 1} Jul 06 15:39:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-afe3c446-19bd-4518-9e0c-fac7fca59df6 1073741824" returned: 0 in 1.850s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-afe3c446-19bd-4518-9e0c-fac7fca59df6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:00 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-afe3c446-19bd-4518-9e0c-fac7fca59df6 Jul 06 15:39:00 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:01 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:39:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Flow 'volume_create_manager' (b3deac5e-ad1e-4188-b3a0-1f5ca7b4680d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2afc8cd3-5467-469c-b505-b7ed76d0e0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2afc8cd3-5467-469c-b505-b7ed76d0e0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-704596366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e80398e1-1176-4827-8362-1a2c26276259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f8cb0bfd2d4796808cba9f8fd325c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:01Z,use_quota=True,user_id='bc830f50823d4d4aa00e17874f8987a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4bfc0d5-7760-4e4e-b583-f80d213090c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4bfc0d5-7760-4e4e-b583-f80d213090c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e270abd-7d06-4a00-8a87-514bf721006c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e270abd-7d06-4a00-8a87-514bf721006c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e80398e1-1176-4827-8362-1a2c26276259', 'volume_name': 'volume-e80398e1-1176-4827-8362-1a2c26276259', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a96c806-f3cb-4497-92a3-cb22cd23c93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a96c806-f3cb-4497-92a3-cb22cd23c93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02e7b66-4f48-4bd2-ab2c-42467bdeb077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:01 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Volume e80398e1-1176-4827-8362-1a2c26276259: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e80398e1-1176-4827-8362-1a2c26276259', 'volume_size': 1} Jul 06 15:39:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:01 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-afe3c446-19bd-4518-9e0c-fac7fca59df6" returned: 0 in 1.221s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] <== create_volume: return (3153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:39:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.161s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.306s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1604266234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb9de614-0264-4a06-b5f6-37ad799ffff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f8cb0bfd2d4796808cba9f8fd325c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:00Z,use_quota=True,user_id='bc830f50823d4d4aa00e17874f8987a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:39:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Creating volume bb9de614-0264-4a06-b5f6-37ad799ffff4 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:39:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:39:01 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:39:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bb9de614-0264-4a06-b5f6-37ad799ffff4 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:01 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bb9de614-0264-4a06-b5f6-37ad799ffff4 1073741824 Jul 06 15:39:01 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fc2e725-aafd-4ab1-8ef2-77dd1db318dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afe3c446-19bd-4518-9e0c-fac7fca59df6', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (294b8d9a-0d46-4430-b9ef-4d3cb4a555b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:01 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Volume volume-afe3c446-19bd-4518-9e0c-fac7fca59df6 (afe3c446-19bd-4518-9e0c-fac7fca59df6): created successfully Jul 06 15:39:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (294b8d9a-0d46-4430-b9ef-4d3cb4a555b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Flow 'volume_create_manager' (fce320e1-147a-4ac1-a999-579955c962db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:02 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-f7f7182e-e04b-4bbc-94f5-aa004d62756a tempest-VolumesListAdminTestJSON-931933360 None] Created volume successfully. Jul 06 15:39:02 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:39:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Flow 'volume_create_manager' (a74a24a3-9822-458e-a593-77c9fa182029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7872a66-4162-4638-a659-8966ae79ed21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7872a66-4162-4638-a659-8966ae79ed21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-365739173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f40d9f9c-4e3c-40f3-b54a-5f3cdfa1b408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f8cb0bfd2d4796808cba9f8fd325c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:02Z,use_quota=True,user_id='bc830f50823d4d4aa00e17874f8987a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c06191b-78d5-48d1-a4e1-5c15b91ce076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c06191b-78d5-48d1-a4e1-5c15b91ce076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e6534f-3c9b-46e2-a384-8781c7509d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e6534f-3c9b-46e2-a384-8781c7509d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f40d9f9c-4e3c-40f3-b54a-5f3cdfa1b408', 'volume_name': 'volume-f40d9f9c-4e3c-40f3-b54a-5f3cdfa1b408', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2969b9b-3f7f-4be5-b34b-c0f0d1d29982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2969b9b-3f7f-4be5-b34b-c0f0d1d29982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:02 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb32115-bd91-4efc-8b55-6e8ad7b47129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:02 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Volume f40d9f9c-4e3c-40f3-b54a-5f3cdfa1b408: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f40d9f9c-4e3c-40f3-b54a-5f3cdfa1b408', 'volume_size': 1} Jul 06 15:39:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:02 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-36819bda-d920-4415-979b-baeaa2356405 tempest-VolumesListAdminTestJSON-931933360 None] Acquiring lock "cinder-afe3c446-19bd-4518-9e0c-fac7fca59df6-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:02 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-36819bda-d920-4415-979b-baeaa2356405 tempest-VolumesListAdminTestJSON-931933360 None] Lock "cinder-afe3c446-19bd-4518-9e0c-fac7fca59df6-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:02 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-36819bda-d920-4415-979b-baeaa2356405 tempest-VolumesListAdminTestJSON-931933360 None] Acquiring lock "cinder-quobyte-afe3c446-19bd-4518-9e0c-fac7fca59df6" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:02 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-36819bda-d920-4415-979b-baeaa2356405 tempest-VolumesListAdminTestJSON-931933360 None] Lock "cinder-quobyte-afe3c446-19bd-4518-9e0c-fac7fca59df6" acquired by "delete_volume" :: waited 0.049s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:03 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e5498c-349e-4e6c-b9ee-bf1f17d1295f]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-36819bda-d920-4415-979b-baeaa2356405 tempest-VolumesListAdminTestJSON-931933360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-afe3c446-19bd-4518-9e0c-fac7fca59df6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:03 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:39:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Flow 'volume_create_manager' (81d1ca12-b269-4687-8053-157355ddb7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edd16e03-203a-446a-bc54-903c2f60c980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:03 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d2e2188b-b076-4a60-82d4-56dd57d6df52 tempest-VolumesListAdminTestJSON-146291946 None] Acquiring lock "cinder-28849298-c9f3-4f2e-9224-3d7b78d881a2-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edd16e03-203a-446a-bc54-903c2f60c980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1393186411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3585855b-7aa6-4440-b369-e1a5668c69d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f8cb0bfd2d4796808cba9f8fd325c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:03Z,use_quota=True,user_id='bc830f50823d4d4aa00e17874f8987a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:03 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-afe3c446-19bd-4518-9e0c-fac7fca59df6 Jul 06 15:39:03 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5789be-608d-4802-a354-fc1e89879c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5789be-608d-4802-a354-fc1e89879c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37791d77-6fa7-4aff-a9ce-8bcba17e8211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37791d77-6fa7-4aff-a9ce-8bcba17e8211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3585855b-7aa6-4440-b369-e1a5668c69d9', 'volume_name': 'volume-3585855b-7aa6-4440-b369-e1a5668c69d9', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abbf9e09-27f4-4bf1-9b74-bd0fb94b5c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abbf9e09-27f4-4bf1-9b74-bd0fb94b5c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e54e6eb-88e3-4500-99d4-c8e7d6035821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:03 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Volume 3585855b-7aa6-4440-b369-e1a5668c69d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3585855b-7aa6-4440-b369-e1a5668c69d9', 'volume_size': 1} Jul 06 15:39:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:03 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d2e2188b-b076-4a60-82d4-56dd57d6df52 tempest-VolumesListAdminTestJSON-146291946 None] Lock "cinder-28849298-c9f3-4f2e-9224-3d7b78d881a2-delete_volume" acquired by "delete_volume" :: waited 0.175s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:03 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d2e2188b-b076-4a60-82d4-56dd57d6df52 tempest-VolumesListAdminTestJSON-146291946 None] Acquiring lock "cinder-quobyte-28849298-c9f3-4f2e-9224-3d7b78d881a2" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:03 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d2e2188b-b076-4a60-82d4-56dd57d6df52 tempest-VolumesListAdminTestJSON-146291946 None] Lock "cinder-quobyte-28849298-c9f3-4f2e-9224-3d7b78d881a2" acquired by "delete_volume" :: waited 0.045s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:03 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfbd54d-57d7-4f0a-a30b-da117aa236bd]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d2e2188b-b076-4a60-82d4-56dd57d6df52 tempest-VolumesListAdminTestJSON-146291946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-28849298-c9f3-4f2e-9224-3d7b78d881a2 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:03 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bb9de614-0264-4a06-b5f6-37ad799ffff4 1073741824" returned: 0 in 1.852s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bb9de614-0264-4a06-b5f6-37ad799ffff4 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:03 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bb9de614-0264-4a06-b5f6-37ad799ffff4 Jul 06 15:39:03 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:03 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-28849298-c9f3-4f2e-9224-3d7b78d881a2 Jul 06 15:39:03 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Flow 'volume_create_manager' (bdfcd6b6-aef3-4de3-bcf7-ce3fb56c4863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe1546d-bd09-477a-9a39-5b4568b1c888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe1546d-bd09-477a-9a39-5b4568b1c888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-803352393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26c81d23-0065-4fd9-b9f6-2a79678e5511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f8cb0bfd2d4796808cba9f8fd325c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:04Z,use_quota=True,user_id='bc830f50823d4d4aa00e17874f8987a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c3351b-fb76-4ebf-a060-9853fd002129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c3351b-fb76-4ebf-a060-9853fd002129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c84ee8b-f5ae-4708-bbe1-08bdc993c6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c84ee8b-f5ae-4708-bbe1-08bdc993c6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26c81d23-0065-4fd9-b9f6-2a79678e5511', 'volume_name': 'volume-26c81d23-0065-4fd9-b9f6-2a79678e5511', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45148f6c-2f42-4af7-a1ab-9c9d6cd8b169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45148f6c-2f42-4af7-a1ab-9c9d6cd8b169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3fc040-b329-425f-b5f9-ce2f06569a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:04 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Volume 26c81d23-0065-4fd9-b9f6-2a79678e5511: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26c81d23-0065-4fd9-b9f6-2a79678e5511', 'volume_size': 1} Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:04 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-36819bda-d920-4415-979b-baeaa2356405 tempest-VolumesListAdminTestJSON-931933360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-afe3c446-19bd-4518-9e0c-fac7fca59df6" returned: 0 in 1.381s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-36819bda-d920-4415-979b-baeaa2356405 tempest-VolumesListAdminTestJSON-931933360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-afe3c446-19bd-4518-9e0c-fac7fca59df6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:04 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-afe3c446-19bd-4518-9e0c-fac7fca59df6 Jul 06 15:39:04 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:04 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bb9de614-0264-4a06-b5f6-37ad799ffff4" returned: 0 in 1.071s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] <== create_volume: return (3078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.088s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.323s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-704596366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e80398e1-1176-4827-8362-1a2c26276259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f8cb0bfd2d4796808cba9f8fd325c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:01Z,use_quota=True,user_id='bc830f50823d4d4aa00e17874f8987a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Creating volume e80398e1-1176-4827-8362-1a2c26276259 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:39:04 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e80398e1-1176-4827-8362-1a2c26276259 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:04 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e80398e1-1176-4827-8362-1a2c26276259 1073741824 Jul 06 15:39:04 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a3cf9c-5db5-419e-b900-03bc1e375ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb9de614-0264-4a06-b5f6-37ad799ffff4', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e909a3d4-c6bc-4880-9b2b-38c898291c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:04 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Volume volume-bb9de614-0264-4a06-b5f6-37ad799ffff4 (bb9de614-0264-4a06-b5f6-37ad799ffff4): created successfully Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e909a3d4-c6bc-4880-9b2b-38c898291c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Flow 'volume_create_manager' (5d17886e-457b-4ce1-b14c-f88fa915bc3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:05 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-aa082ae4-1b9d-4c65-baf5-c0e097096ebb tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Created volume successfully. Jul 06 15:39:05 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d2e2188b-b076-4a60-82d4-56dd57d6df52 tempest-VolumesListAdminTestJSON-146291946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-28849298-c9f3-4f2e-9224-3d7b78d881a2" returned: 0 in 1.644s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d2e2188b-b076-4a60-82d4-56dd57d6df52 tempest-VolumesListAdminTestJSON-146291946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-28849298-c9f3-4f2e-9224-3d7b78d881a2 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:05 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-28849298-c9f3-4f2e-9224-3d7b78d881a2 Jul 06 15:39:05 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:05 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-36819bda-d920-4415-979b-baeaa2356405 tempest-VolumesListAdminTestJSON-931933360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-afe3c446-19bd-4518-9e0c-fac7fca59df6" returned: 0 in 1.202s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:05 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-36819bda-d920-4415-979b-baeaa2356405 tempest-VolumesListAdminTestJSON-931933360 None] Lock "cinder-quobyte-afe3c446-19bd-4518-9e0c-fac7fca59df6" released by "delete_volume" :: held 2.691s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:05 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-36819bda-d920-4415-979b-baeaa2356405 tempest-VolumesListAdminTestJSON-931933360 None] Created reservations ['bb927e76-52f8-4036-b44c-fc1da7ee6038', 'b17c65a4-20f8-4031-8790-cca0c708994a', '1dc5c168-0a80-4f49-8496-5863015671ac', '724c318f-b6df-4f63-9985-3370846ce3aa'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-36819bda-d920-4415-979b-baeaa2356405 tempest-VolumesListAdminTestJSON-931933360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-36819bda-d920-4415-979b-baeaa2356405 tempest-VolumesListAdminTestJSON-931933360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:05 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-36819bda-d920-4415-979b-baeaa2356405 tempest-VolumesListAdminTestJSON-931933360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:05 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-36819bda-d920-4415-979b-baeaa2356405 tempest-VolumesListAdminTestJSON-931933360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-36819bda-d920-4415-979b-baeaa2356405 tempest-VolumesListAdminTestJSON-931933360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-36819bda-d920-4415-979b-baeaa2356405 tempest-VolumesListAdminTestJSON-931933360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:05 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:39:05 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:06 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d2e2188b-b076-4a60-82d4-56dd57d6df52 tempest-VolumesListAdminTestJSON-146291946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-28849298-c9f3-4f2e-9224-3d7b78d881a2" returned: 0 in 1.062s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:06 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:06 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d2e2188b-b076-4a60-82d4-56dd57d6df52 tempest-VolumesListAdminTestJSON-146291946 None] Lock "cinder-quobyte-28849298-c9f3-4f2e-9224-3d7b78d881a2" released by "delete_volume" :: held 2.776s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e80398e1-1176-4827-8362-1a2c26276259 1073741824" returned: 0 in 1.367s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e80398e1-1176-4827-8362-1a2c26276259 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:06 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e80398e1-1176-4827-8362-1a2c26276259 Jul 06 15:39:06 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:06 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-d2e2188b-b076-4a60-82d4-56dd57d6df52 tempest-VolumesListAdminTestJSON-146291946 None] Created reservations ['5afe1adf-ec9c-4752-b9d1-0b66769bbc96', '64daf2ed-d0ae-459f-a32f-1f2c2a8621c3', '082bdf0f-b8f8-48ca-8b4d-67136b5099c6', '8c0876c5-3044-40f2-8446-81757a3ba593'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d2e2188b-b076-4a60-82d4-56dd57d6df52 tempest-VolumesListAdminTestJSON-146291946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d2e2188b-b076-4a60-82d4-56dd57d6df52 tempest-VolumesListAdminTestJSON-146291946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:06 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d2e2188b-b076-4a60-82d4-56dd57d6df52 tempest-VolumesListAdminTestJSON-146291946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:06 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d2e2188b-b076-4a60-82d4-56dd57d6df52 tempest-VolumesListAdminTestJSON-146291946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d2e2188b-b076-4a60-82d4-56dd57d6df52 tempest-VolumesListAdminTestJSON-146291946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d2e2188b-b076-4a60-82d4-56dd57d6df52 tempest-VolumesListAdminTestJSON-146291946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:06 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:39:06 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:06 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-36819bda-d920-4415-979b-baeaa2356405 tempest-VolumesListAdminTestJSON-931933360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.878s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:06 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-36819bda-d920-4415-979b-baeaa2356405 tempest-VolumesListAdminTestJSON-931933360 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:06 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-36819bda-d920-4415-979b-baeaa2356405 tempest-VolumesListAdminTestJSON-931933360 None] Deleted volume successfully. Jul 06 15:39:06 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-36819bda-d920-4415-979b-baeaa2356405 tempest-VolumesListAdminTestJSON-931933360 None] Lock "cinder-afe3c446-19bd-4518-9e0c-fac7fca59df6-delete_volume" released by "delete_volume" :: held 3.999s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:06 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-de9bd5ed-b79d-4c47-a0d7-5623c577bed7 tempest-VolumesListAdminTestJSON-146291946 None] Acquiring lock "cinder-26226a4f-40bb-4455-89fd-7b74fb431252-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:06 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-de9bd5ed-b79d-4c47-a0d7-5623c577bed7 tempest-VolumesListAdminTestJSON-146291946 None] Lock "cinder-26226a4f-40bb-4455-89fd-7b74fb431252-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:06 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-de9bd5ed-b79d-4c47-a0d7-5623c577bed7 tempest-VolumesListAdminTestJSON-146291946 None] Acquiring lock "cinder-quobyte-26226a4f-40bb-4455-89fd-7b74fb431252" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:06 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-de9bd5ed-b79d-4c47-a0d7-5623c577bed7 tempest-VolumesListAdminTestJSON-146291946 None] Lock "cinder-quobyte-26226a4f-40bb-4455-89fd-7b74fb431252" acquired by "delete_volume" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:06 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[690e46a6-a89d-4757-bc61-34557c0d0736]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-de9bd5ed-b79d-4c47-a0d7-5623c577bed7 tempest-VolumesListAdminTestJSON-146291946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-26226a4f-40bb-4455-89fd-7b74fb431252 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:07 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-26226a4f-40bb-4455-89fd-7b74fb431252 Jul 06 15:39:07 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:07 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e80398e1-1176-4827-8362-1a2c26276259" returned: 0 in 0.872s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] <== create_volume: return (2307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.309s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.836s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-365739173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f40d9f9c-4e3c-40f3-b54a-5f3cdfa1b408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f8cb0bfd2d4796808cba9f8fd325c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:02Z,use_quota=True,user_id='bc830f50823d4d4aa00e17874f8987a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Creating volume f40d9f9c-4e3c-40f3-b54a-5f3cdfa1b408 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:39:07 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f40d9f9c-4e3c-40f3-b54a-5f3cdfa1b408 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:07 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d2e2188b-b076-4a60-82d4-56dd57d6df52 tempest-VolumesListAdminTestJSON-146291946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.768s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-d2e2188b-b076-4a60-82d4-56dd57d6df52 tempest-VolumesListAdminTestJSON-146291946 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:07 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f40d9f9c-4e3c-40f3-b54a-5f3cdfa1b408 1073741824 Jul 06 15:39:07 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-d2e2188b-b076-4a60-82d4-56dd57d6df52 tempest-VolumesListAdminTestJSON-146291946 None] Deleted volume successfully. Jul 06 15:39:07 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02e7b66-4f48-4bd2-ab2c-42467bdeb077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e80398e1-1176-4827-8362-1a2c26276259', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2339b63-6041-4d60-b207-db04d1607d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:07 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Volume volume-e80398e1-1176-4827-8362-1a2c26276259 (e80398e1-1176-4827-8362-1a2c26276259): created successfully Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2339b63-6041-4d60-b207-db04d1607d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Flow 'volume_create_manager' (b3deac5e-ad1e-4188-b3a0-1f5ca7b4680d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d2e2188b-b076-4a60-82d4-56dd57d6df52 tempest-VolumesListAdminTestJSON-146291946 None] Lock "cinder-28849298-c9f3-4f2e-9224-3d7b78d881a2-delete_volume" released by "delete_volume" :: held 3.970s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:07 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-c44c2391-4637-47f8-b1d2-f206bd91f046 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Created volume successfully. Jul 06 15:39:07 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-de9bd5ed-b79d-4c47-a0d7-5623c577bed7 tempest-VolumesListAdminTestJSON-146291946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-26226a4f-40bb-4455-89fd-7b74fb431252" returned: 0 in 0.859s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-de9bd5ed-b79d-4c47-a0d7-5623c577bed7 tempest-VolumesListAdminTestJSON-146291946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-26226a4f-40bb-4455-89fd-7b74fb431252 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:07 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-26226a4f-40bb-4455-89fd-7b74fb431252 Jul 06 15:39:07 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Flow 'volume_create_manager' (fb2a56b5-8b55-4a34-9452-cc938a6bb79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2141853-b0c7-48ea-bdb6-b0d25bb13bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2141853-b0c7-48ea-bdb6-b0d25bb13bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1091869511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5cce599-b566-49ec-963a-7829ff3f0e81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46c9039c882446b87dd59eeca720484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:08Z,use_quota=True,user_id='7a3e87de529d463a8a436d6fa967a958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d528a1-e5f2-44f3-86e1-a2024eb76d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d528a1-e5f2-44f3-86e1-a2024eb76d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a3d2176-13fe-42a0-a184-d4c6e44dbfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a3d2176-13fe-42a0-a184-d4c6e44dbfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5cce599-b566-49ec-963a-7829ff3f0e81', 'volume_name': 'volume-f5cce599-b566-49ec-963a-7829ff3f0e81', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c20ef02-0fe1-4d91-b3bc-4f3d5e390104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c20ef02-0fe1-4d91-b3bc-4f3d5e390104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3af981-7cbc-477c-bcfc-882b7d30037f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:07 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Volume f5cce599-b566-49ec-963a-7829ff3f0e81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5cce599-b566-49ec-963a-7829ff3f0e81', 'volume_size': 1} Jul 06 15:39:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:08 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f40d9f9c-4e3c-40f3-b54a-5f3cdfa1b408 1073741824" returned: 0 in 0.983s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f40d9f9c-4e3c-40f3-b54a-5f3cdfa1b408 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:08 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f40d9f9c-4e3c-40f3-b54a-5f3cdfa1b408 Jul 06 15:39:08 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:08 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-de9bd5ed-b79d-4c47-a0d7-5623c577bed7 tempest-VolumesListAdminTestJSON-146291946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-26226a4f-40bb-4455-89fd-7b74fb431252" returned: 0 in 0.671s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:08 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-de9bd5ed-b79d-4c47-a0d7-5623c577bed7 tempest-VolumesListAdminTestJSON-146291946 None] Lock "cinder-quobyte-26226a4f-40bb-4455-89fd-7b74fb431252" released by "delete_volume" :: held 1.587s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:08 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-de9bd5ed-b79d-4c47-a0d7-5623c577bed7 tempest-VolumesListAdminTestJSON-146291946 None] Created reservations ['26d1b9f9-cf4c-4771-9736-7bb207624cc0', '9c95eaeb-c7d7-4500-b3fa-3169919609da', 'a788a006-13ba-4375-ac01-d0304bfc73dd', '39f5b22a-5980-4e74-847d-50e646d5a983'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-de9bd5ed-b79d-4c47-a0d7-5623c577bed7 tempest-VolumesListAdminTestJSON-146291946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-de9bd5ed-b79d-4c47-a0d7-5623c577bed7 tempest-VolumesListAdminTestJSON-146291946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-de9bd5ed-b79d-4c47-a0d7-5623c577bed7 tempest-VolumesListAdminTestJSON-146291946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-de9bd5ed-b79d-4c47-a0d7-5623c577bed7 tempest-VolumesListAdminTestJSON-146291946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-de9bd5ed-b79d-4c47-a0d7-5623c577bed7 tempest-VolumesListAdminTestJSON-146291946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-de9bd5ed-b79d-4c47-a0d7-5623c577bed7 tempest-VolumesListAdminTestJSON-146291946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:08 devstack sudo[100721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:39:08 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:08 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f40d9f9c-4e3c-40f3-b54a-5f3cdfa1b408" returned: 0 in 0.638s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:39:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.527s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1393186411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3585855b-7aa6-4440-b369-e1a5668c69d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f8cb0bfd2d4796808cba9f8fd325c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:03Z,use_quota=True,user_id='bc830f50823d4d4aa00e17874f8987a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:39:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Creating volume 3585855b-7aa6-4440-b369-e1a5668c69d9 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:39:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:39:08 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:39:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3585855b-7aa6-4440-b369-e1a5668c69d9 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:08 devstack sudo[100725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3585855b-7aa6-4440-b369-e1a5668c69d9 1073741824 Jul 06 15:39:08 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb32115-bd91-4efc-8b55-6e8ad7b47129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f40d9f9c-4e3c-40f3-b54a-5f3cdfa1b408', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8592004f-6e05-40cd-8c43-8dace124fb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:08 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Volume volume-f40d9f9c-4e3c-40f3-b54a-5f3cdfa1b408 (f40d9f9c-4e3c-40f3-b54a-5f3cdfa1b408): created successfully Jul 06 15:39:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8592004f-6e05-40cd-8c43-8dace124fb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Flow 'volume_create_manager' (a74a24a3-9822-458e-a593-77c9fa182029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:08 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-fc533a33-6839-46bf-8a5a-297a90450465 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Created volume successfully. Jul 06 15:39:09 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6eb3fcfe-5ab8-4fd8-b006-5944e75cf5ff tempest-VolumesListAdminTestJSON-146291946 None] Acquiring lock "cinder-932f911a-ab86-42d1-943e-aac488bb2a87-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:09 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6eb3fcfe-5ab8-4fd8-b006-5944e75cf5ff tempest-VolumesListAdminTestJSON-146291946 None] Lock "cinder-932f911a-ab86-42d1-943e-aac488bb2a87-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:09 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6eb3fcfe-5ab8-4fd8-b006-5944e75cf5ff tempest-VolumesListAdminTestJSON-146291946 None] Acquiring lock "cinder-quobyte-932f911a-ab86-42d1-943e-aac488bb2a87" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:09 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6eb3fcfe-5ab8-4fd8-b006-5944e75cf5ff tempest-VolumesListAdminTestJSON-146291946 None] Lock "cinder-quobyte-932f911a-ab86-42d1-943e-aac488bb2a87" acquired by "delete_volume" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:09 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c4feef-4718-4bc5-a2f3-43139a2b4118]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6eb3fcfe-5ab8-4fd8-b006-5944e75cf5ff tempest-VolumesListAdminTestJSON-146291946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-932f911a-ab86-42d1-943e-aac488bb2a87 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:09 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-de9bd5ed-b79d-4c47-a0d7-5623c577bed7 tempest-VolumesListAdminTestJSON-146291946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.669s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:09 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-de9bd5ed-b79d-4c47-a0d7-5623c577bed7 tempest-VolumesListAdminTestJSON-146291946 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:09 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-de9bd5ed-b79d-4c47-a0d7-5623c577bed7 tempest-VolumesListAdminTestJSON-146291946 None] Deleted volume successfully. Jul 06 15:39:09 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-de9bd5ed-b79d-4c47-a0d7-5623c577bed7 tempest-VolumesListAdminTestJSON-146291946 None] Lock "cinder-26226a4f-40bb-4455-89fd-7b74fb431252-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:09 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-932f911a-ab86-42d1-943e-aac488bb2a87 Jul 06 15:39:09 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:09 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3585855b-7aa6-4440-b369-e1a5668c69d9 1073741824" returned: 0 in 0.847s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3585855b-7aa6-4440-b369-e1a5668c69d9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:09 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3585855b-7aa6-4440-b369-e1a5668c69d9 Jul 06 15:39:09 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:09 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6eb3fcfe-5ab8-4fd8-b006-5944e75cf5ff tempest-VolumesListAdminTestJSON-146291946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-932f911a-ab86-42d1-943e-aac488bb2a87" returned: 0 in 0.766s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6eb3fcfe-5ab8-4fd8-b006-5944e75cf5ff tempest-VolumesListAdminTestJSON-146291946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-932f911a-ab86-42d1-943e-aac488bb2a87 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:09 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-932f911a-ab86-42d1-943e-aac488bb2a87 Jul 06 15:39:09 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:10 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3585855b-7aa6-4440-b369-e1a5668c69d9" returned: 0 in 0.648s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:10 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:39:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.215s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:10 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-803352393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26c81d23-0065-4fd9-b9f6-2a79678e5511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f8cb0bfd2d4796808cba9f8fd325c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:04Z,use_quota=True,user_id='bc830f50823d4d4aa00e17874f8987a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:39:10 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Creating volume 26c81d23-0065-4fd9-b9f6-2a79678e5511 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:39:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:10 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:10 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:10 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:39:10 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:39:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-26c81d23-0065-4fd9-b9f6-2a79678e5511 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e54e6eb-88e3-4500-99d4-c8e7d6035821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3585855b-7aa6-4440-b369-e1a5668c69d9', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:10 devstack sudo[100741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-26c81d23-0065-4fd9-b9f6-2a79678e5511 1073741824 Jul 06 15:39:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6efcab6e-e7ea-443a-9fcb-d5cab4f9500a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:10 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:10 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Volume volume-3585855b-7aa6-4440-b369-e1a5668c69d9 (3585855b-7aa6-4440-b369-e1a5668c69d9): created successfully Jul 06 15:39:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6efcab6e-e7ea-443a-9fcb-d5cab4f9500a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Flow 'volume_create_manager' (81d1ca12-b269-4687-8053-157355ddb7ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:10 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-25dd9f0a-04e5-472c-9f46-57b3c9666112 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Created volume successfully. Jul 06 15:39:10 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6eb3fcfe-5ab8-4fd8-b006-5944e75cf5ff tempest-VolumesListAdminTestJSON-146291946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-932f911a-ab86-42d1-943e-aac488bb2a87" returned: 0 in 0.641s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6eb3fcfe-5ab8-4fd8-b006-5944e75cf5ff tempest-VolumesListAdminTestJSON-146291946 None] Lock "cinder-quobyte-932f911a-ab86-42d1-943e-aac488bb2a87" released by "delete_volume" :: held 1.452s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:10 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-6eb3fcfe-5ab8-4fd8-b006-5944e75cf5ff tempest-VolumesListAdminTestJSON-146291946 None] Created reservations ['cda31565-dd51-4d42-a7ee-e22480c05763', '3af09f44-cfbb-49f2-96d6-3d67a27b35c9', '9a383765-5bfc-4f86-90fd-336cc3de324b', '926c1da8-de5f-4f90-a2cc-e34282f2dfd3'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6eb3fcfe-5ab8-4fd8-b006-5944e75cf5ff tempest-VolumesListAdminTestJSON-146291946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6eb3fcfe-5ab8-4fd8-b006-5944e75cf5ff tempest-VolumesListAdminTestJSON-146291946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:10 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6eb3fcfe-5ab8-4fd8-b006-5944e75cf5ff tempest-VolumesListAdminTestJSON-146291946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:10 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6eb3fcfe-5ab8-4fd8-b006-5944e75cf5ff tempest-VolumesListAdminTestJSON-146291946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6eb3fcfe-5ab8-4fd8-b006-5944e75cf5ff tempest-VolumesListAdminTestJSON-146291946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6eb3fcfe-5ab8-4fd8-b006-5944e75cf5ff tempest-VolumesListAdminTestJSON-146291946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:10 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:39:10 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:11 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-26c81d23-0065-4fd9-b9f6-2a79678e5511 1073741824" returned: 0 in 0.878s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-26c81d23-0065-4fd9-b9f6-2a79678e5511 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:11 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-26c81d23-0065-4fd9-b9f6-2a79678e5511 Jul 06 15:39:11 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:11 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6eb3fcfe-5ab8-4fd8-b006-5944e75cf5ff tempest-VolumesListAdminTestJSON-146291946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.697s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:11 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-6eb3fcfe-5ab8-4fd8-b006-5944e75cf5ff tempest-VolumesListAdminTestJSON-146291946 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:11 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-6eb3fcfe-5ab8-4fd8-b006-5944e75cf5ff tempest-VolumesListAdminTestJSON-146291946 None] Deleted volume successfully. Jul 06 15:39:11 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6eb3fcfe-5ab8-4fd8-b006-5944e75cf5ff tempest-VolumesListAdminTestJSON-146291946 None] Lock "cinder-932f911a-ab86-42d1-943e-aac488bb2a87-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:12 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-26c81d23-0065-4fd9-b9f6-2a79678e5511" returned: 0 in 0.735s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:39:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.129s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1091869511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5cce599-b566-49ec-963a-7829ff3f0e81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46c9039c882446b87dd59eeca720484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:08Z,use_quota=True,user_id='7a3e87de529d463a8a436d6fa967a958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:39:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Creating volume f5cce599-b566-49ec-963a-7829ff3f0e81 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:39:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:39:12 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:39:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:12 devstack sudo[100753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81 1073741824 Jul 06 15:39:12 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3fc040-b329-425f-b5f9-ce2f06569a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26c81d23-0065-4fd9-b9f6-2a79678e5511', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38142f45-3ce3-4768-b063-d57651240bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:12 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Volume volume-26c81d23-0065-4fd9-b9f6-2a79678e5511 (26c81d23-0065-4fd9-b9f6-2a79678e5511): created successfully Jul 06 15:39:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38142f45-3ce3-4768-b063-d57651240bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Flow 'volume_create_manager' (bdfcd6b6-aef3-4de3-bcf7-ce3fb56c4863) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:12 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-e55c4c3a-b68c-4274-a947-8b19ff063e37 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Created volume successfully. Jul 06 15:39:12 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4a90e51d-4d6c-47c1-b128-09542e696c82 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "cinder-26c81d23-0065-4fd9-b9f6-2a79678e5511-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:12 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4a90e51d-4d6c-47c1-b128-09542e696c82 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "cinder-26c81d23-0065-4fd9-b9f6-2a79678e5511-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:12 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4a90e51d-4d6c-47c1-b128-09542e696c82 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "cinder-quobyte-26c81d23-0065-4fd9-b9f6-2a79678e5511" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:12 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4a90e51d-4d6c-47c1-b128-09542e696c82 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "cinder-quobyte-26c81d23-0065-4fd9-b9f6-2a79678e5511" acquired by "delete_volume" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:12 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7de020-486d-4114-b506-41521cfa609a]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4a90e51d-4d6c-47c1-b128-09542e696c82 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-26c81d23-0065-4fd9-b9f6-2a79678e5511 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:13 devstack sudo[100759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-26c81d23-0065-4fd9-b9f6-2a79678e5511 Jul 06 15:39:13 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:13 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81 1073741824" returned: 0 in 1.091s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:13 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81 Jul 06 15:39:13 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:13 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4a90e51d-4d6c-47c1-b128-09542e696c82 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-26c81d23-0065-4fd9-b9f6-2a79678e5511" returned: 0 in 0.963s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4a90e51d-4d6c-47c1-b128-09542e696c82 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-26c81d23-0065-4fd9-b9f6-2a79678e5511 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:13 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-26c81d23-0065-4fd9-b9f6-2a79678e5511 Jul 06 15:39:13 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:14 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81" returned: 0 in 0.857s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] <== create_volume: return (2000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:39:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3af981-7cbc-477c-bcfc-882b7d30037f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5cce599-b566-49ec-963a-7829ff3f0e81', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668c64af-30d5-40eb-8c4f-19e84ddf9760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:14 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Volume volume-f5cce599-b566-49ec-963a-7829ff3f0e81 (f5cce599-b566-49ec-963a-7829ff3f0e81): created successfully Jul 06 15:39:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668c64af-30d5-40eb-8c4f-19e84ddf9760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Flow 'volume_create_manager' (fb2a56b5-8b55-4a34-9452-cc938a6bb79a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:14 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-980804b9-49b1-4389-a6c3-1665083aecd1 tempest-CreateVolumesFromSnapshotTest-781471547 None] Created volume successfully. Jul 06 15:39:14 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4a90e51d-4d6c-47c1-b128-09542e696c82 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-26c81d23-0065-4fd9-b9f6-2a79678e5511" returned: 0 in 0.767s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4a90e51d-4d6c-47c1-b128-09542e696c82 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "cinder-quobyte-26c81d23-0065-4fd9-b9f6-2a79678e5511" released by "delete_volume" :: held 1.795s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:14 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-4a90e51d-4d6c-47c1-b128-09542e696c82 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Created reservations ['26d2e979-d97d-4d99-8472-a91352f57a04', '020893a2-b334-4514-a11a-4fdb4e5b00ff', '48baa644-96ef-4179-a3e2-7063c4842766', 'ed329e33-b132-469e-a98f-c9c2c868347c'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4a90e51d-4d6c-47c1-b128-09542e696c82 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4a90e51d-4d6c-47c1-b128-09542e696c82 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4a90e51d-4d6c-47c1-b128-09542e696c82 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4a90e51d-4d6c-47c1-b128-09542e696c82 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4a90e51d-4d6c-47c1-b128-09542e696c82 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4a90e51d-4d6c-47c1-b128-09542e696c82 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:14 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:39:14 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:15 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6fa14613-ac4b-406b-9525-f8013ac38bd2 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "cinder-3585855b-7aa6-4440-b369-e1a5668c69d9-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:15 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6fa14613-ac4b-406b-9525-f8013ac38bd2 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "cinder-3585855b-7aa6-4440-b369-e1a5668c69d9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:15 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6fa14613-ac4b-406b-9525-f8013ac38bd2 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "cinder-quobyte-3585855b-7aa6-4440-b369-e1a5668c69d9" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:15 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6fa14613-ac4b-406b-9525-f8013ac38bd2 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "cinder-quobyte-3585855b-7aa6-4440-b369-e1a5668c69d9" acquired by "delete_volume" :: waited 0.013s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:15 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ec33b2-50e2-44ff-a961-93f3570441be]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6fa14613-ac4b-406b-9525-f8013ac38bd2 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3585855b-7aa6-4440-b369-e1a5668c69d9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:15 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3585855b-7aa6-4440-b369-e1a5668c69d9 Jul 06 15:39:15 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:15 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4a90e51d-4d6c-47c1-b128-09542e696c82 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.705s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:15 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-4a90e51d-4d6c-47c1-b128-09542e696c82 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:15 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-4a90e51d-4d6c-47c1-b128-09542e696c82 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Deleted volume successfully. Jul 06 15:39:15 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4a90e51d-4d6c-47c1-b128-09542e696c82 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "cinder-26c81d23-0065-4fd9-b9f6-2a79678e5511-delete_volume" released by "delete_volume" :: held 2.769s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5cf4055e-b490-4724-8adb-8d3270ce4f21 tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5cf4055e-b490-4724-8adb-8d3270ce4f21 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:15 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-5cf4055e-b490-4724-8adb-8d3270ce4f21 tempest-CreateVolumesFromSnapshotTest-781471547 None] Creating offline snapshot f02896b9-9f2f-4b71-be73-b5f78119164f of volume f5cce599-b566-49ec-963a-7829ff3f0e81 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:39:15 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b1780e-f462-4bc3-9456-45e2739ed1ce]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5cf4055e-b490-4724-8adb-8d3270ce4f21 tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:15 devstack sudo[100782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81 Jul 06 15:39:15 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:16 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6fa14613-ac4b-406b-9525-f8013ac38bd2 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3585855b-7aa6-4440-b369-e1a5668c69d9" returned: 0 in 0.910s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6fa14613-ac4b-406b-9525-f8013ac38bd2 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3585855b-7aa6-4440-b369-e1a5668c69d9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:16 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3585855b-7aa6-4440-b369-e1a5668c69d9 Jul 06 15:39:16 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:16 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5cf4055e-b490-4724-8adb-8d3270ce4f21 tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81" returned: 0 in 0.801s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5cf4055e-b490-4724-8adb-8d3270ce4f21 tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81.f02896b9-9f2f-4b71-be73-b5f78119164f 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:16 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81.f02896b9-9f2f-4b71-be73-b5f78119164f 1G Jul 06 15:39:16 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:16 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6fa14613-ac4b-406b-9525-f8013ac38bd2 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3585855b-7aa6-4440-b369-e1a5668c69d9" returned: 0 in 0.784s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:16 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6fa14613-ac4b-406b-9525-f8013ac38bd2 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "cinder-quobyte-3585855b-7aa6-4440-b369-e1a5668c69d9" released by "delete_volume" :: held 1.762s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:17 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-6fa14613-ac4b-406b-9525-f8013ac38bd2 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Created reservations ['18b48afc-0ab5-4d3b-9805-b8fc1bbd5b2a', 'cecc7f77-5f56-4944-b326-b1e8d89f7d52', '43bd440b-5bd8-463a-a792-c0327fe1327c', '13627ef6-3e55-48a5-bc19-e88460324458'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6fa14613-ac4b-406b-9525-f8013ac38bd2 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6fa14613-ac4b-406b-9525-f8013ac38bd2 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:17 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6fa14613-ac4b-406b-9525-f8013ac38bd2 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:17 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6fa14613-ac4b-406b-9525-f8013ac38bd2 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6fa14613-ac4b-406b-9525-f8013ac38bd2 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6fa14613-ac4b-406b-9525-f8013ac38bd2 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:17 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:39:17 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:17 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-52b8c355-9a28-4964-afee-5c18e403d8ea tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "cinder-f40d9f9c-4e3c-40f3-b54a-5f3cdfa1b408-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:17 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-52b8c355-9a28-4964-afee-5c18e403d8ea tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "cinder-f40d9f9c-4e3c-40f3-b54a-5f3cdfa1b408-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:17 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-52b8c355-9a28-4964-afee-5c18e403d8ea tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "cinder-quobyte-f40d9f9c-4e3c-40f3-b54a-5f3cdfa1b408" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:17 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-52b8c355-9a28-4964-afee-5c18e403d8ea tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "cinder-quobyte-f40d9f9c-4e3c-40f3-b54a-5f3cdfa1b408" acquired by "delete_volume" :: waited 0.025s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:17 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5cf4055e-b490-4724-8adb-8d3270ce4f21 tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81.f02896b9-9f2f-4b71-be73-b5f78119164f 1G" returned: 0 in 1.065s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5cf4055e-b490-4724-8adb-8d3270ce4f21 tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5cce599-b566-49ec-963a-7829ff3f0e81 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81.f02896b9-9f2f-4b71-be73-b5f78119164f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:17 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[b417e020-a9f0-4671-a4bb-9bb5f3ef099d]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-52b8c355-9a28-4964-afee-5c18e403d8ea tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f40d9f9c-4e3c-40f3-b54a-5f3cdfa1b408 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:17 devstack sudo[100804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5cce599-b566-49ec-963a-7829ff3f0e81 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81.f02896b9-9f2f-4b71-be73-b5f78119164f Jul 06 15:39:17 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:17 devstack sudo[100809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f40d9f9c-4e3c-40f3-b54a-5f3cdfa1b408 Jul 06 15:39:17 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-7f2cbe2c-31e7-4c20-ac8c-4843cfb62755 req-77026909-21e2-4a99-9a44-f639d2c69042 tempest-TestInstancesWithCinderVolumes-396084605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:17 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6fa14613-ac4b-406b-9525-f8013ac38bd2 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.859s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:17 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-6fa14613-ac4b-406b-9525-f8013ac38bd2 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:17 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-6fa14613-ac4b-406b-9525-f8013ac38bd2 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Deleted volume successfully. Jul 06 15:39:17 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6fa14613-ac4b-406b-9525-f8013ac38bd2 tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "cinder-3585855b-7aa6-4440-b369-e1a5668c69d9-delete_volume" released by "delete_volume" :: held 2.853s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:18 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5cf4055e-b490-4724-8adb-8d3270ce4f21 tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5cce599-b566-49ec-963a-7829ff3f0e81 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81.f02896b9-9f2f-4b71-be73-b5f78119164f" returned: 0 in 0.801s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:18 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-5cf4055e-b490-4724-8adb-8d3270ce4f21 tempest-CreateVolumesFromSnapshotTest-781471547 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81.f02896b9-9f2f-4b71-be73-b5f78119164f is being set with open permissions: ugo+rw Jul 06 15:39:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5cf4055e-b490-4724-8adb-8d3270ce4f21 tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81.f02896b9-9f2f-4b71-be73-b5f78119164f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:18 devstack sudo[100820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81.f02896b9-9f2f-4b71-be73-b5f78119164f Jul 06 15:39:18 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:18 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-52b8c355-9a28-4964-afee-5c18e403d8ea tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f40d9f9c-4e3c-40f3-b54a-5f3cdfa1b408" returned: 0 in 0.905s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-52b8c355-9a28-4964-afee-5c18e403d8ea tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f40d9f9c-4e3c-40f3-b54a-5f3cdfa1b408 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:18 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f40d9f9c-4e3c-40f3-b54a-5f3cdfa1b408 Jul 06 15:39:18 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:18 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5cf4055e-b490-4724-8adb-8d3270ce4f21 tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81.f02896b9-9f2f-4b71-be73-b5f78119164f" returned: 0 in 0.665s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5cf4055e-b490-4724-8adb-8d3270ce4f21 tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:19 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81.info Jul 06 15:39:19 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:19 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-52b8c355-9a28-4964-afee-5c18e403d8ea tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f40d9f9c-4e3c-40f3-b54a-5f3cdfa1b408" returned: 0 in 0.691s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-52b8c355-9a28-4964-afee-5c18e403d8ea tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "cinder-quobyte-f40d9f9c-4e3c-40f3-b54a-5f3cdfa1b408" released by "delete_volume" :: held 1.659s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:19 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-52b8c355-9a28-4964-afee-5c18e403d8ea tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Created reservations ['a774780b-81bc-4581-8596-0753a0fc4375', 'ec8548aa-663a-400b-bfed-2f5445a125b4', '4728a696-64de-459f-9d59-1c68a8d59f39', 'f0b9cf01-a48d-4341-a4a6-13659f36aef2'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-52b8c355-9a28-4964-afee-5c18e403d8ea tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-52b8c355-9a28-4964-afee-5c18e403d8ea tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:19 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-52b8c355-9a28-4964-afee-5c18e403d8ea tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:19 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-52b8c355-9a28-4964-afee-5c18e403d8ea tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-52b8c355-9a28-4964-afee-5c18e403d8ea tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-52b8c355-9a28-4964-afee-5c18e403d8ea tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:19 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:39:19 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2ea9b01a-e054-4bef-a604-347b7b9f485e tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "cinder-e80398e1-1176-4827-8362-1a2c26276259-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2ea9b01a-e054-4bef-a604-347b7b9f485e tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "cinder-e80398e1-1176-4827-8362-1a2c26276259-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5cf4055e-b490-4724-8adb-8d3270ce4f21 tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81.info" returned: 0 in 0.767s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:19 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-5cf4055e-b490-4724-8adb-8d3270ce4f21 tempest-CreateVolumesFromSnapshotTest-781471547 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81.info is being set with open permissions: ugo+rw Jul 06 15:39:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5cf4055e-b490-4724-8adb-8d3270ce4f21 tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:19 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2ea9b01a-e054-4bef-a604-347b7b9f485e tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "cinder-quobyte-e80398e1-1176-4827-8362-1a2c26276259" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:19 devstack sudo[100832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81.info Jul 06 15:39:19 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2ea9b01a-e054-4bef-a604-347b7b9f485e tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "cinder-quobyte-e80398e1-1176-4827-8362-1a2c26276259" acquired by "delete_volume" :: waited 0.053s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:19 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7e15bd-64bc-42e8-9d9e-f25483a845f8]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ea9b01a-e054-4bef-a604-347b7b9f485e tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e80398e1-1176-4827-8362-1a2c26276259 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:20 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e80398e1-1176-4827-8362-1a2c26276259 Jul 06 15:39:20 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:20 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-52b8c355-9a28-4964-afee-5c18e403d8ea tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.779s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:20 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-52b8c355-9a28-4964-afee-5c18e403d8ea tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:20 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-52b8c355-9a28-4964-afee-5c18e403d8ea tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Deleted volume successfully. Jul 06 15:39:20 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-52b8c355-9a28-4964-afee-5c18e403d8ea tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "cinder-f40d9f9c-4e3c-40f3-b54a-5f3cdfa1b408-delete_volume" released by "delete_volume" :: held 2.781s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:20 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5cf4055e-b490-4724-8adb-8d3270ce4f21 tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81.info" returned: 0 in 0.802s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5cf4055e-b490-4724-8adb-8d3270ce4f21 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.996s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-7f2cbe2c-31e7-4c20-ac8c-4843cfb62755 req-77026909-21e2-4a99-9a44-f639d2c69042 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.831s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:20 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a614d35-d1d7-40f7-8111-f5faf7ea77b9]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-7f2cbe2c-31e7-4c20-ac8c-4843cfb62755 req-77026909-21e2-4a99-9a44-f639d2c69042 tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f0144b92-8dbd-4d3e-ac95-9356d32968eb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:20 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-5cf4055e-b490-4724-8adb-8d3270ce4f21 tempest-CreateVolumesFromSnapshotTest-781471547 None] Create snapshot completed successfully Jul 06 15:39:20 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f0144b92-8dbd-4d3e-ac95-9356d32968eb Jul 06 15:39:20 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:20 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ea9b01a-e054-4bef-a604-347b7b9f485e tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e80398e1-1176-4827-8362-1a2c26276259" returned: 0 in 0.897s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ea9b01a-e054-4bef-a604-347b7b9f485e tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e80398e1-1176-4827-8362-1a2c26276259 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:20 devstack sudo[100843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e80398e1-1176-4827-8362-1a2c26276259 Jul 06 15:39:20 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:21 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ea9b01a-e054-4bef-a604-347b7b9f485e tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e80398e1-1176-4827-8362-1a2c26276259" returned: 0 in 0.723s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:21 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-7f2cbe2c-31e7-4c20-ac8c-4843cfb62755 req-77026909-21e2-4a99-9a44-f639d2c69042 tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f0144b92-8dbd-4d3e-ac95-9356d32968eb" returned: 0 in 0.893s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-7f2cbe2c-31e7-4c20-ac8c-4843cfb62755 req-77026909-21e2-4a99-9a44-f639d2c69042 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.921s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:21 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2ea9b01a-e054-4bef-a604-347b7b9f485e tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "cinder-quobyte-e80398e1-1176-4827-8362-1a2c26276259" released by "delete_volume" :: held 1.692s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-7f2cbe2c-31e7-4c20-ac8c-4843cfb62755 req-77026909-21e2-4a99-9a44-f639d2c69042 tempest-TestInstancesWithCinderVolumes-396084605 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce', 'name': 'volume-f0144b92-8dbd-4d3e-ac95-9356d32968eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b86e5576-a298-4178-9e31-4fbc21ef0344', 'enforce_multipath': True} {{(pid=86148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:39:21 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:39:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Flow 'volume_create_manager' (1528a664-dbd4-4192-a18d-0a6e06d9513f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (691f0280-d98b-4f80-bf21-9ecd3d764ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (691f0280-d98b-4f80-bf21-9ecd3d764ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-331167393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790ac4ca-5098-4c10-a195-85ad12b5d50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46c9039c882446b87dd59eeca720484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:22Z,use_quota=True,user_id='7a3e87de529d463a8a436d6fa967a958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab2fb45-849e-451d-87e9-463b59de0d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab2fb45-849e-451d-87e9-463b59de0d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cbca5b1-13d4-4f8c-a489-7802303d56f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cbca5b1-13d4-4f8c-a489-7802303d56f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '790ac4ca-5098-4c10-a195-85ad12b5d50b', 'volume_name': 'volume-790ac4ca-5098-4c10-a195-85ad12b5d50b', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ededd70-68b1-4789-809b-0059ac77d6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ededd70-68b1-4789-809b-0059ac77d6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67685a20-c9a6-469f-b375-75b901b7b296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:21 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Volume 790ac4ca-5098-4c10-a195-85ad12b5d50b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-790ac4ca-5098-4c10-a195-85ad12b5d50b', 'volume_size': 1} Jul 06 15:39:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-331167393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790ac4ca-5098-4c10-a195-85ad12b5d50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46c9039c882446b87dd59eeca720484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:22Z,use_quota=True,user_id='7a3e87de529d463a8a436d6fa967a958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:39:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Creating volume 790ac4ca-5098-4c10-a195-85ad12b5d50b {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:39:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:39:21 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:39:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-790ac4ca-5098-4c10-a195-85ad12b5d50b 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:21 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-2ea9b01a-e054-4bef-a604-347b7b9f485e tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Created reservations ['68bce05d-ab55-47ab-b7c1-3a13f37a4bc2', '6c3a3e84-0a73-4206-9abb-fa3e660cdb2a', '56cdbf60-4c74-4464-8271-63357caa4ff1', '1c3faba2-460a-4f0a-8615-c0213a7d620b'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:21 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-790ac4ca-5098-4c10-a195-85ad12b5d50b 1073741824 Jul 06 15:39:21 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Flow 'volume_create_manager' (d8bd69e5-decb-4129-acef-c7824659b8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbe31398-a490-42b6-85df-734469822083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:22 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-7f2cbe2c-31e7-4c20-ac8c-4843cfb62755 req-77026909-21e2-4a99-9a44-f639d2c69042 tempest-TestInstancesWithCinderVolumes-396084605 None] attachment_update completed successfully. Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbe31398-a490-42b6-85df-734469822083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-262846534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f3cff6-7877-4691-bcb8-11a6ebeb998a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46c9039c882446b87dd59eeca720484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:22Z,use_quota=True,user_id='7a3e87de529d463a8a436d6fa967a958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9d0a2a6-fbc2-4057-8326-ca071350b119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9d0a2a6-fbc2-4057-8326-ca071350b119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a2d3f4-4a15-4ecb-8329-531008de2dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a2d3f4-4a15-4ecb-8329-531008de2dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9f3cff6-7877-4691-bcb8-11a6ebeb998a', 'volume_name': 'volume-e9f3cff6-7877-4691-bcb8-11a6ebeb998a', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e096072a-2109-4348-a496-279c1b6e39e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e096072a-2109-4348-a496-279c1b6e39e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091c5033-fdce-4525-966a-bd130d6469d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:22 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Volume e9f3cff6-7877-4691-bcb8-11a6ebeb998a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9f3cff6-7877-4691-bcb8-11a6ebeb998a', 'volume_size': 1} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2ea9b01a-e054-4bef-a604-347b7b9f485e tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2ea9b01a-e054-4bef-a604-347b7b9f485e tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2ea9b01a-e054-4bef-a604-347b7b9f485e tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2ea9b01a-e054-4bef-a604-347b7b9f485e tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2ea9b01a-e054-4bef-a604-347b7b9f485e tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ea9b01a-e054-4bef-a604-347b7b9f485e tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:22 devstack sudo[100851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:39:22 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-aaeb2fc0-0abf-4438-b659-d1df2903100c tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "cinder-bb9de614-0264-4a06-b5f6-37ad799ffff4-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-aaeb2fc0-0abf-4438-b659-d1df2903100c tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "cinder-bb9de614-0264-4a06-b5f6-37ad799ffff4-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Flow 'volume_create_manager' (1047511b-967b-4450-b277-9b2f7d27f6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d699c5-8d92-4168-b5b3-8d0718df0045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d699c5-8d92-4168-b5b3-8d0718df0045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2137522058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f648ed4-3a50-488a-9ea8-3d4a6e6fccfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46c9039c882446b87dd59eeca720484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:22Z,use_quota=True,user_id='7a3e87de529d463a8a436d6fa967a958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12495734-cffe-45e2-a6b6-64b009b201d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12495734-cffe-45e2-a6b6-64b009b201d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a33063-77d0-4472-8afc-d6cf6155d643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a33063-77d0-4472-8afc-d6cf6155d643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f648ed4-3a50-488a-9ea8-3d4a6e6fccfa', 'volume_name': 'volume-1f648ed4-3a50-488a-9ea8-3d4a6e6fccfa', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c39ecc-7c1a-46b5-bd4c-18f292dd5c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c39ecc-7c1a-46b5-bd4c-18f292dd5c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16fbea11-4f0f-409d-a2c4-42f46b8aca76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:22 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Volume 1f648ed4-3a50-488a-9ea8-3d4a6e6fccfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f648ed4-3a50-488a-9ea8-3d4a6e6fccfa', 'volume_size': 1} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-aaeb2fc0-0abf-4438-b659-d1df2903100c tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "cinder-quobyte-bb9de614-0264-4a06-b5f6-37ad799ffff4" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-aaeb2fc0-0abf-4438-b659-d1df2903100c tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "cinder-quobyte-bb9de614-0264-4a06-b5f6-37ad799ffff4" acquired by "delete_volume" :: waited 0.020s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[513aa824-608d-49e8-8f91-7959742b07fc]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-aaeb2fc0-0abf-4438-b659-d1df2903100c tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bb9de614-0264-4a06-b5f6-37ad799ffff4 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:23 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bb9de614-0264-4a06-b5f6-37ad799ffff4 Jul 06 15:39:23 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:39:23 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Flow 'volume_create_manager' (f7542476-d506-4880-a2c6-67b4f483f35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2dd9004-3b15-44d5-9fc9-6d034053e455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-790ac4ca-5098-4c10-a195-85ad12b5d50b 1073741824" returned: 0 in 1.295s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2dd9004-3b15-44d5-9fc9-6d034053e455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-271042705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=225f779f-e5f8-4e5f-b593-8fbccb0615bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46c9039c882446b87dd59eeca720484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:23Z,use_quota=True,user_id='7a3e87de529d463a8a436d6fa967a958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6da368a1-646b-4f50-999c-21294ecf99a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6da368a1-646b-4f50-999c-21294ecf99a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f11411e9-05c2-4065-abb7-72049ade3fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f11411e9-05c2-4065-abb7-72049ade3fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '225f779f-e5f8-4e5f-b593-8fbccb0615bf', 'volume_name': 'volume-225f779f-e5f8-4e5f-b593-8fbccb0615bf', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f930a95e-401d-4dc1-8f87-a4e41cb1416e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f930a95e-401d-4dc1-8f87-a4e41cb1416e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248c2358-7f97-4020-9862-55d8169dc615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:23 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Volume 225f779f-e5f8-4e5f-b593-8fbccb0615bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-225f779f-e5f8-4e5f-b593-8fbccb0615bf', 'volume_size': 1} Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:23 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2ea9b01a-e054-4bef-a604-347b7b9f485e tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.185s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-2ea9b01a-e054-4bef-a604-347b7b9f485e tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:23 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-2ea9b01a-e054-4bef-a604-347b7b9f485e tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Deleted volume successfully. Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2ea9b01a-e054-4bef-a604-347b7b9f485e tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "cinder-e80398e1-1176-4827-8362-1a2c26276259-delete_volume" released by "delete_volume" :: held 3.650s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-790ac4ca-5098-4c10-a195-85ad12b5d50b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:23 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-790ac4ca-5098-4c10-a195-85ad12b5d50b Jul 06 15:39:23 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Flow 'volume_create_manager' (ddd95820-51e1-484d-8e77-93874f59187f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (523a90e8-56f1-45ae-8fb8-60b6e4842348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (523a90e8-56f1-45ae-8fb8-60b6e4842348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1342338148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f59149-8da0-4ddb-91f4-bb6751becf5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46c9039c882446b87dd59eeca720484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:24Z,use_quota=True,user_id='7a3e87de529d463a8a436d6fa967a958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21f6ec48-0ec0-4b9b-874e-47467deb5345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21f6ec48-0ec0-4b9b-874e-47467deb5345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41eb681a-a185-47ef-9b67-f3cda82dcd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41eb681a-a185-47ef-9b67-f3cda82dcd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66f59149-8da0-4ddb-91f4-bb6751becf5c', 'volume_name': 'volume-66f59149-8da0-4ddb-91f4-bb6751becf5c', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c5642c4-aaa9-4d3d-afce-dacd9caec20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c5642c4-aaa9-4d3d-afce-dacd9caec20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdee0c1b-f2a3-444b-b445-685f6b243350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:23 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Volume 66f59149-8da0-4ddb-91f4-bb6751becf5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66f59149-8da0-4ddb-91f4-bb6751becf5c', 'volume_size': 1} Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:23 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-aaeb2fc0-0abf-4438-b659-d1df2903100c tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bb9de614-0264-4a06-b5f6-37ad799ffff4" returned: 0 in 1.133s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-aaeb2fc0-0abf-4438-b659-d1df2903100c tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bb9de614-0264-4a06-b5f6-37ad799ffff4 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:23 devstack sudo[100866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bb9de614-0264-4a06-b5f6-37ad799ffff4 Jul 06 15:39:23 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Flow 'volume_create_manager' (cf2e08e8-6049-468c-a712-9b6bbf93b8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af927e5-3a2d-47e8-a1d6-44b2ccf472cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af927e5-3a2d-47e8-a1d6-44b2ccf472cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1232797418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ddac76b-23a1-4ff3-8964-4344054d45a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d0d20421454ebfbc68846618bdc158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:24Z,use_quota=True,user_id='b004f33515344ee2bb21bd794bdda03d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:24 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7032a6c-2bc5-4947-8e5f-16537deacd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7032a6c-2bc5-4947-8e5f-16537deacd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d0fc7c8-ea2f-4327-a120-12cbde91573c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d0fc7c8-ea2f-4327-a120-12cbde91573c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ddac76b-23a1-4ff3-8964-4344054d45a9', 'volume_name': 'volume-2ddac76b-23a1-4ff3-8964-4344054d45a9', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c6133c-a1fc-48b9-a9a7-43f2cb94c43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c6133c-a1fc-48b9-a9a7-43f2cb94c43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b415d214-d73e-4bac-9412-64d5c3ab62b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:24 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Volume 2ddac76b-23a1-4ff3-8964-4344054d45a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ddac76b-23a1-4ff3-8964-4344054d45a9', 'volume_size': 1} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-790ac4ca-5098-4c10-a195-85ad12b5d50b" returned: 0 in 0.831s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] <== create_volume: return (2318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.320s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.073s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-262846534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f3cff6-7877-4691-bcb8-11a6ebeb998a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46c9039c882446b87dd59eeca720484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:22Z,use_quota=True,user_id='7a3e87de529d463a8a436d6fa967a958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Creating volume e9f3cff6-7877-4691-bcb8-11a6ebeb998a {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:39:24 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e9f3cff6-7877-4691-bcb8-11a6ebeb998a 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:24 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e9f3cff6-7877-4691-bcb8-11a6ebeb998a 1073741824 Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67685a20-c9a6-469f-b375-75b901b7b296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-790ac4ca-5098-4c10-a195-85ad12b5d50b', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:24 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec08542-8bbc-4448-99cd-c7aa0553fc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:24 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Volume volume-790ac4ca-5098-4c10-a195-85ad12b5d50b (790ac4ca-5098-4c10-a195-85ad12b5d50b): created successfully Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec08542-8bbc-4448-99cd-c7aa0553fc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Flow 'volume_create_manager' (1528a664-dbd4-4192-a18d-0a6e06d9513f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:24 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-3da4ed07-bfd6-4d84-8272-5ec638de4bdc tempest-CreateVolumesFromSnapshotTest-781471547 None] Created volume successfully. Jul 06 15:39:24 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-aaeb2fc0-0abf-4438-b659-d1df2903100c tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bb9de614-0264-4a06-b5f6-37ad799ffff4" returned: 0 in 0.688s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-aaeb2fc0-0abf-4438-b659-d1df2903100c tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "cinder-quobyte-bb9de614-0264-4a06-b5f6-37ad799ffff4" released by "delete_volume" :: held 1.887s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-aaeb2fc0-0abf-4438-b659-d1df2903100c tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Created reservations ['18c19d65-e9f2-4440-b678-3c54d8a5165c', '2b2cff72-5847-45d4-bc3c-98a97151fae6', '21c0614a-caed-4acd-9425-4a0c3957137a', 'e2a6de98-3bad-46b8-a5e2-d046486b0c30'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-aaeb2fc0-0abf-4438-b659-d1df2903100c tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-aaeb2fc0-0abf-4438-b659-d1df2903100c tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb2fc0-0abf-4438-b659-d1df2903100c tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-aaeb2fc0-0abf-4438-b659-d1df2903100c tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-aaeb2fc0-0abf-4438-b659-d1df2903100c tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-aaeb2fc0-0abf-4438-b659-d1df2903100c tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:24 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:39:24 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ba54ed2d-1361-46f7-b3cb-b2b83d3fdd0d tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "cinder-45290403-7e8a-4d55-8f79-2b415cdede13-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ba54ed2d-1361-46f7-b3cb-b2b83d3fdd0d tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "cinder-45290403-7e8a-4d55-8f79-2b415cdede13-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ba54ed2d-1361-46f7-b3cb-b2b83d3fdd0d tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "cinder-quobyte-45290403-7e8a-4d55-8f79-2b415cdede13" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ba54ed2d-1361-46f7-b3cb-b2b83d3fdd0d tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "cinder-quobyte-45290403-7e8a-4d55-8f79-2b415cdede13" acquired by "delete_volume" :: waited 0.025s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9025329-6704-4965-9ec8-6163b3c3f87b]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ba54ed2d-1361-46f7-b3cb-b2b83d3fdd0d tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-45290403-7e8a-4d55-8f79-2b415cdede13 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:25 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-45290403-7e8a-4d55-8f79-2b415cdede13 Jul 06 15:39:25 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:25 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e9f3cff6-7877-4691-bcb8-11a6ebeb998a 1073741824" returned: 0 in 0.971s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e9f3cff6-7877-4691-bcb8-11a6ebeb998a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:25 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e9f3cff6-7877-4691-bcb8-11a6ebeb998a Jul 06 15:39:25 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:25 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-aaeb2fc0-0abf-4438-b659-d1df2903100c tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.686s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:25 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-aaeb2fc0-0abf-4438-b659-d1df2903100c tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:25 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-aaeb2fc0-0abf-4438-b659-d1df2903100c tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Deleted volume successfully. Jul 06 15:39:25 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-aaeb2fc0-0abf-4438-b659-d1df2903100c tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "cinder-bb9de614-0264-4a06-b5f6-37ad799ffff4-delete_volume" released by "delete_volume" :: held 2.945s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:25 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ba54ed2d-1361-46f7-b3cb-b2b83d3fdd0d tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-45290403-7e8a-4d55-8f79-2b415cdede13" returned: 0 in 0.815s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ba54ed2d-1361-46f7-b3cb-b2b83d3fdd0d tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-45290403-7e8a-4d55-8f79-2b415cdede13 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:25 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-45290403-7e8a-4d55-8f79-2b415cdede13 Jul 06 15:39:25 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:25 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e9f3cff6-7877-4691-bcb8-11a6ebeb998a" returned: 0 in 0.652s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:25 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:39:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.150s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:25 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2137522058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f648ed4-3a50-488a-9ea8-3d4a6e6fccfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46c9039c882446b87dd59eeca720484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:22Z,use_quota=True,user_id='7a3e87de529d463a8a436d6fa967a958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:39:25 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Creating volume 1f648ed4-3a50-488a-9ea8-3d4a6e6fccfa {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:39:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:25 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:25 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:25 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:39:25 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:39:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1f648ed4-3a50-488a-9ea8-3d4a6e6fccfa 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:25 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091c5033-fdce-4525-966a-bd130d6469d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9f3cff6-7877-4691-bcb8-11a6ebeb998a', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:25 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1f648ed4-3a50-488a-9ea8-3d4a6e6fccfa 1073741824 Jul 06 15:39:25 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:25 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc112152-5081-41b0-a35d-ec87ecd87585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:25 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Volume volume-e9f3cff6-7877-4691-bcb8-11a6ebeb998a (e9f3cff6-7877-4691-bcb8-11a6ebeb998a): created successfully Jul 06 15:39:25 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc112152-5081-41b0-a35d-ec87ecd87585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:25 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Flow 'volume_create_manager' (d8bd69e5-decb-4129-acef-c7824659b8f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:25 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-f2d5ba7f-2730-46cd-b69a-d1c2676af779 tempest-CreateVolumesFromSnapshotTest-781471547 None] Created volume successfully. Jul 06 15:39:26 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ba54ed2d-1361-46f7-b3cb-b2b83d3fdd0d tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-45290403-7e8a-4d55-8f79-2b415cdede13" returned: 0 in 0.657s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ba54ed2d-1361-46f7-b3cb-b2b83d3fdd0d tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "cinder-quobyte-45290403-7e8a-4d55-8f79-2b415cdede13" released by "delete_volume" :: held 1.522s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:26 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-ba54ed2d-1361-46f7-b3cb-b2b83d3fdd0d tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Created reservations ['11f37ff6-8c0e-4f62-84f6-850c99776b6e', '56a30fe0-9269-4145-919a-5a80a88a3355', 'c165cdba-626b-4c96-8083-3f7d59ebd667', 'efec01c4-6646-49a8-bfa7-1d583573f84a'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ba54ed2d-1361-46f7-b3cb-b2b83d3fdd0d tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ba54ed2d-1361-46f7-b3cb-b2b83d3fdd0d tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:26 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ba54ed2d-1361-46f7-b3cb-b2b83d3fdd0d tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:26 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ba54ed2d-1361-46f7-b3cb-b2b83d3fdd0d tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ba54ed2d-1361-46f7-b3cb-b2b83d3fdd0d tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ba54ed2d-1361-46f7-b3cb-b2b83d3fdd0d tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:26 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:39:26 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:26 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1f648ed4-3a50-488a-9ea8-3d4a6e6fccfa 1073741824" returned: 0 in 0.970s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1f648ed4-3a50-488a-9ea8-3d4a6e6fccfa {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:26 devstack sudo[100905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1f648ed4-3a50-488a-9ea8-3d4a6e6fccfa Jul 06 15:39:26 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:27 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ba54ed2d-1361-46f7-b3cb-b2b83d3fdd0d tempest-CreateVolumesFromSourceVolumeTest-966217965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.661s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:27 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-ba54ed2d-1361-46f7-b3cb-b2b83d3fdd0d tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:27 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-ba54ed2d-1361-46f7-b3cb-b2b83d3fdd0d tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Deleted volume successfully. Jul 06 15:39:27 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ba54ed2d-1361-46f7-b3cb-b2b83d3fdd0d tempest-CreateVolumesFromSourceVolumeTest-966217965 None] Lock "cinder-45290403-7e8a-4d55-8f79-2b415cdede13-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:27 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1f648ed4-3a50-488a-9ea8-3d4a6e6fccfa" returned: 0 in 0.666s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:27 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:39:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.241s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:27 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-271042705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=225f779f-e5f8-4e5f-b593-8fbccb0615bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46c9039c882446b87dd59eeca720484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:23Z,use_quota=True,user_id='7a3e87de529d463a8a436d6fa967a958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:39:27 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Creating volume 225f779f-e5f8-4e5f-b593-8fbccb0615bf {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:39:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:27 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:27 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:27 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:39:27 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:39:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-225f779f-e5f8-4e5f-b593-8fbccb0615bf 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:27 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-225f779f-e5f8-4e5f-b593-8fbccb0615bf 1073741824 Jul 06 15:39:27 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:27 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16fbea11-4f0f-409d-a2c4-42f46b8aca76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f648ed4-3a50-488a-9ea8-3d4a6e6fccfa', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:27 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd865ca-24b7-4dc4-8efe-19f528398378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:27 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Volume volume-1f648ed4-3a50-488a-9ea8-3d4a6e6fccfa (1f648ed4-3a50-488a-9ea8-3d4a6e6fccfa): created successfully Jul 06 15:39:27 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd865ca-24b7-4dc4-8efe-19f528398378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:27 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Flow 'volume_create_manager' (1047511b-967b-4450-b277-9b2f7d27f6ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:27 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-1662bc5d-a7c5-426c-acfb-ff39d73e83fd tempest-CreateVolumesFromSnapshotTest-781471547 None] Created volume successfully. Jul 06 15:39:28 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-225f779f-e5f8-4e5f-b593-8fbccb0615bf 1073741824" returned: 0 in 0.891s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-225f779f-e5f8-4e5f-b593-8fbccb0615bf {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:28 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-225f779f-e5f8-4e5f-b593-8fbccb0615bf Jul 06 15:39:28 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:29 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-225f779f-e5f8-4e5f-b593-8fbccb0615bf" returned: 0 in 0.654s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:29 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:39:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.374s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:29 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1342338148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f59149-8da0-4ddb-91f4-bb6751becf5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46c9039c882446b87dd59eeca720484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:24Z,use_quota=True,user_id='7a3e87de529d463a8a436d6fa967a958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:39:29 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Creating volume 66f59149-8da0-4ddb-91f4-bb6751becf5c {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:39:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:29 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:29 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:29 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:39:29 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:39:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-66f59149-8da0-4ddb-91f4-bb6751becf5c 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248c2358-7f97-4020-9862-55d8169dc615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-225f779f-e5f8-4e5f-b593-8fbccb0615bf', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:29 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-66f59149-8da0-4ddb-91f4-bb6751becf5c 1073741824 Jul 06 15:39:29 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620f92b6-f666-42f2-add2-5d999aa0496d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:29 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Volume volume-225f779f-e5f8-4e5f-b593-8fbccb0615bf (225f779f-e5f8-4e5f-b593-8fbccb0615bf): created successfully Jul 06 15:39:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620f92b6-f666-42f2-add2-5d999aa0496d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Flow 'volume_create_manager' (f7542476-d506-4880-a2c6-67b4f483f35b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:29 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-2d80b247-28d2-49b1-b09c-9b43d427b605 tempest-CreateVolumesFromSnapshotTest-781471547 None] Created volume successfully. Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-855d92cc-0978-4eda-8b17-5e7ade6f14e9 req-eee9e7c9-2b2f-410b-90fd-a7ffcdf079ac tempest-TestInstancesWithCinderVolumes-396084605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:30 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-66f59149-8da0-4ddb-91f4-bb6751becf5c 1073741824" returned: 0 in 0.935s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-66f59149-8da0-4ddb-91f4-bb6751becf5c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:30 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-66f59149-8da0-4ddb-91f4-bb6751becf5c Jul 06 15:39:30 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Flow 'volume_create_manager' (cf91caa6-a676-46f5-87da-3be406f7dc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ecb322d-1b1f-469d-aa22-b7f155775100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ecb322d-1b1f-469d-aa22-b7f155775100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1353943144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd45e16-323c-4375-88f7-3afbbf669d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e84c538490d490faf2b2e446b219fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:31Z,use_quota=True,user_id='9b1dee45c227471fb4fee38a96d8e5fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5adf78db-de85-4719-b063-e28296d5da76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5adf78db-de85-4719-b063-e28296d5da76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (610e0e66-a142-4590-a55d-95d8f9c8c321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (610e0e66-a142-4590-a55d-95d8f9c8c321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fd45e16-323c-4375-88f7-3afbbf669d43', 'volume_name': 'volume-5fd45e16-323c-4375-88f7-3afbbf669d43', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ddc6342-8e51-49e7-bf97-3a33cde1f5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ddc6342-8e51-49e7-bf97-3a33cde1f5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c00c8feb-c99c-4946-9adf-e4448ab0de66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:30 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Volume 5fd45e16-323c-4375-88f7-3afbbf669d43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fd45e16-323c-4375-88f7-3afbbf669d43', 'volume_size': 1} Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:30 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-66f59149-8da0-4ddb-91f4-bb6751becf5c" returned: 0 in 0.695s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.648s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1232797418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ddac76b-23a1-4ff3-8964-4344054d45a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d0d20421454ebfbc68846618bdc158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:24Z,use_quota=True,user_id='b004f33515344ee2bb21bd794bdda03d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Creating volume 2ddac76b-23a1-4ff3-8964-4344054d45a9 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:39:30 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2ddac76b-23a1-4ff3-8964-4344054d45a9 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:30 devstack sudo[100936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2ddac76b-23a1-4ff3-8964-4344054d45a9 1073741824 Jul 06 15:39:30 devstack sudo[100936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdee0c1b-f2a3-444b-b445-685f6b243350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66f59149-8da0-4ddb-91f4-bb6751becf5c', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a9e543-e66f-41d9-aaa1-02b6637bfd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:30 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Volume volume-66f59149-8da0-4ddb-91f4-bb6751becf5c (66f59149-8da0-4ddb-91f4-bb6751becf5c): created successfully Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a9e543-e66f-41d9-aaa1-02b6637bfd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Flow 'volume_create_manager' (ddd95820-51e1-484d-8e77-93874f59187f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:30 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-7f0808a5-964f-49ca-b1e7-f1e7a4338723 tempest-CreateVolumesFromSnapshotTest-781471547 None] Created volume successfully. Jul 06 15:39:31 devstack sudo[100936]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2ddac76b-23a1-4ff3-8964-4344054d45a9 1073741824" returned: 0 in 0.767s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2ddac76b-23a1-4ff3-8964-4344054d45a9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:31 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2ddac76b-23a1-4ff3-8964-4344054d45a9 Jul 06 15:39:31 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-87dda1cf-f5a2-4832-91f6-25ab8bd40aae tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "cinder-66f59149-8da0-4ddb-91f4-bb6751becf5c-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-87dda1cf-f5a2-4832-91f6-25ab8bd40aae tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-66f59149-8da0-4ddb-91f4-bb6751becf5c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-87dda1cf-f5a2-4832-91f6-25ab8bd40aae tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "cinder-quobyte-66f59149-8da0-4ddb-91f4-bb6751becf5c" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-87dda1cf-f5a2-4832-91f6-25ab8bd40aae tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-quobyte-66f59149-8da0-4ddb-91f4-bb6751becf5c" acquired by "delete_volume" :: waited 0.019s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:32 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[83dc81ec-a035-4243-b169-d137153c1e60]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-87dda1cf-f5a2-4832-91f6-25ab8bd40aae tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-66f59149-8da0-4ddb-91f4-bb6751becf5c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:32 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2ddac76b-23a1-4ff3-8964-4344054d45a9" returned: 0 in 0.631s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:32 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:39:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-855d92cc-0978-4eda-8b17-5e7ade6f14e9 req-eee9e7c9-2b2f-410b-90fd-a7ffcdf079ac tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.255s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b415d214-d73e-4bac-9412-64d5c3ab62b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ddac76b-23a1-4ff3-8964-4344054d45a9', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48924a83-c790-4b1f-b3dc-f0f6c845d220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:32 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2136de0-6134-4ae6-a7f1-92929754c6b2]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-855d92cc-0978-4eda-8b17-5e7ade6f14e9 req-eee9e7c9-2b2f-410b-90fd-a7ffcdf079ac tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-aae3b6be-4884-4c0a-bdb4-c30159797430 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:32 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Volume volume-2ddac76b-23a1-4ff3-8964-4344054d45a9 (2ddac76b-23a1-4ff3-8964-4344054d45a9): created successfully Jul 06 15:39:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48924a83-c790-4b1f-b3dc-f0f6c845d220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Flow 'volume_create_manager' (cf2e08e8-6049-468c-a712-9b6bbf93b8e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:32 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-66f59149-8da0-4ddb-91f4-bb6751becf5c Jul 06 15:39:32 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:32 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-2db01c49-1ebb-43b0-b9f6-eb37fdd5eaf7 tempest-VolumesTransfersV357Test-1048002472 None] Created volume successfully. Jul 06 15:39:32 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-aae3b6be-4884-4c0a-bdb4-c30159797430 Jul 06 15:39:32 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:33 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-87dda1cf-f5a2-4832-91f6-25ab8bd40aae tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-66f59149-8da0-4ddb-91f4-bb6751becf5c" returned: 0 in 0.771s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-87dda1cf-f5a2-4832-91f6-25ab8bd40aae tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-66f59149-8da0-4ddb-91f4-bb6751becf5c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:33 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-66f59149-8da0-4ddb-91f4-bb6751becf5c Jul 06 15:39:33 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:33 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-855d92cc-0978-4eda-8b17-5e7ade6f14e9 req-eee9e7c9-2b2f-410b-90fd-a7ffcdf079ac tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-aae3b6be-4884-4c0a-bdb4-c30159797430" returned: 0 in 0.743s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-855d92cc-0978-4eda-8b17-5e7ade6f14e9 req-eee9e7c9-2b2f-410b-90fd-a7ffcdf079ac tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.768s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.242s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1353943144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd45e16-323c-4375-88f7-3afbbf669d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e84c538490d490faf2b2e446b219fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:31Z,use_quota=True,user_id='9b1dee45c227471fb4fee38a96d8e5fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:39:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Creating volume 5fd45e16-323c-4375-88f7-3afbbf669d43 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:39:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:39:33 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:39:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5fd45e16-323c-4375-88f7-3afbbf669d43 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:33 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5fd45e16-323c-4375-88f7-3afbbf669d43 1073741824 Jul 06 15:39:33 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-855d92cc-0978-4eda-8b17-5e7ade6f14e9 req-eee9e7c9-2b2f-410b-90fd-a7ffcdf079ac tempest-TestInstancesWithCinderVolumes-396084605 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce', 'name': 'volume-aae3b6be-4884-4c0a-bdb4-c30159797430', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18284827-2c1f-4ad8-b278-dd1e6745b3d2', 'enforce_multipath': True} {{(pid=86148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:39:33 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-855d92cc-0978-4eda-8b17-5e7ade6f14e9 req-eee9e7c9-2b2f-410b-90fd-a7ffcdf079ac tempest-TestInstancesWithCinderVolumes-396084605 None] attachment_update completed successfully. Jul 06 15:39:33 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-87dda1cf-f5a2-4832-91f6-25ab8bd40aae tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-66f59149-8da0-4ddb-91f4-bb6751becf5c" returned: 0 in 0.723s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:33 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-87dda1cf-f5a2-4832-91f6-25ab8bd40aae tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-quobyte-66f59149-8da0-4ddb-91f4-bb6751becf5c" released by "delete_volume" :: held 1.538s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:33 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-6451d724-6c9b-423f-b2bf-19aa0e0d378b tempest-VolumesTransfersV357Test-24008123 None] Transfer volume completed successfully. Jul 06 15:39:33 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-87dda1cf-f5a2-4832-91f6-25ab8bd40aae tempest-CreateVolumesFromSnapshotTest-781471547 None] Created reservations ['35c95152-4c9e-4957-bf17-00996698bd92', '8ec8dd62-ddae-4900-8816-02da672a3ba8', '1233363d-99f4-43be-96af-3258abc04f24', '3d6653a5-d187-4e55-8d8b-7fcf0f891d4c'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-87dda1cf-f5a2-4832-91f6-25ab8bd40aae tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-87dda1cf-f5a2-4832-91f6-25ab8bd40aae tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-87dda1cf-f5a2-4832-91f6-25ab8bd40aae tempest-CreateVolumesFromSnapshotTest-781471547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-87dda1cf-f5a2-4832-91f6-25ab8bd40aae tempest-CreateVolumesFromSnapshotTest-781471547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-87dda1cf-f5a2-4832-91f6-25ab8bd40aae tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-87dda1cf-f5a2-4832-91f6-25ab8bd40aae tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:33 devstack sudo[100963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:39:33 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:34 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5fd45e16-323c-4375-88f7-3afbbf669d43 1073741824" returned: 0 in 0.946s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5fd45e16-323c-4375-88f7-3afbbf669d43 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:34 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5fd45e16-323c-4375-88f7-3afbbf669d43 Jul 06 15:39:34 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:34 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1dcdad35-0c3f-49ff-99da-1029477413c5 tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "cinder-225f779f-e5f8-4e5f-b593-8fbccb0615bf-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:34 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1dcdad35-0c3f-49ff-99da-1029477413c5 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-225f779f-e5f8-4e5f-b593-8fbccb0615bf-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:34 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1dcdad35-0c3f-49ff-99da-1029477413c5 tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "cinder-quobyte-225f779f-e5f8-4e5f-b593-8fbccb0615bf" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:34 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1dcdad35-0c3f-49ff-99da-1029477413c5 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-quobyte-225f779f-e5f8-4e5f-b593-8fbccb0615bf" acquired by "delete_volume" :: waited 0.020s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:34 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a0545d-a985-4251-87b7-49fc9bb0af55]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1dcdad35-0c3f-49ff-99da-1029477413c5 tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-225f779f-e5f8-4e5f-b593-8fbccb0615bf {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:34 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-225f779f-e5f8-4e5f-b593-8fbccb0615bf Jul 06 15:39:34 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:34 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-87dda1cf-f5a2-4832-91f6-25ab8bd40aae tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.804s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:34 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-87dda1cf-f5a2-4832-91f6-25ab8bd40aae tempest-CreateVolumesFromSnapshotTest-781471547 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:34 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-87dda1cf-f5a2-4832-91f6-25ab8bd40aae tempest-CreateVolumesFromSnapshotTest-781471547 None] Deleted volume successfully. Jul 06 15:39:34 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-87dda1cf-f5a2-4832-91f6-25ab8bd40aae tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-66f59149-8da0-4ddb-91f4-bb6751becf5c-delete_volume" released by "delete_volume" :: held 2.616s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:34 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5fd45e16-323c-4375-88f7-3afbbf669d43" returned: 0 in 0.876s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:39:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c00c8feb-c99c-4946-9adf-e4448ab0de66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fd45e16-323c-4375-88f7-3afbbf669d43', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f369e6ec-f2fe-45d0-b1d6-0ea6b6afb024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:34 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Volume volume-5fd45e16-323c-4375-88f7-3afbbf669d43 (5fd45e16-323c-4375-88f7-3afbbf669d43): created successfully Jul 06 15:39:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f369e6ec-f2fe-45d0-b1d6-0ea6b6afb024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Flow 'volume_create_manager' (cf91caa6-a676-46f5-87da-3be406f7dc79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:35 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-d01b64d5-9837-498a-9a1c-2245a4983d08 tempest-ProjectReaderTests-741168160 None] Created volume successfully. Jul 06 15:39:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d2f726ef-08e1-4f34-a7b0-a85e1df9f597 tempest-VolumesTransfersV357Test-1874424773 None] Acquiring lock "cinder-2ddac76b-23a1-4ff3-8964-4344054d45a9-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d2f726ef-08e1-4f34-a7b0-a85e1df9f597 tempest-VolumesTransfersV357Test-1874424773 None] Lock "cinder-2ddac76b-23a1-4ff3-8964-4344054d45a9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d2f726ef-08e1-4f34-a7b0-a85e1df9f597 tempest-VolumesTransfersV357Test-1874424773 None] Acquiring lock "cinder-quobyte-2ddac76b-23a1-4ff3-8964-4344054d45a9" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d2f726ef-08e1-4f34-a7b0-a85e1df9f597 tempest-VolumesTransfersV357Test-1874424773 None] Lock "cinder-quobyte-2ddac76b-23a1-4ff3-8964-4344054d45a9" acquired by "delete_volume" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:35 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[0548a32f-82cf-4f87-965a-83a3beb5677e]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d2f726ef-08e1-4f34-a7b0-a85e1df9f597 tempest-VolumesTransfersV357Test-1874424773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2ddac76b-23a1-4ff3-8964-4344054d45a9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:35 devstack sudo[100976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2ddac76b-23a1-4ff3-8964-4344054d45a9 Jul 06 15:39:35 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:35 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1dcdad35-0c3f-49ff-99da-1029477413c5 tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-225f779f-e5f8-4e5f-b593-8fbccb0615bf" returned: 0 in 0.843s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1dcdad35-0c3f-49ff-99da-1029477413c5 tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-225f779f-e5f8-4e5f-b593-8fbccb0615bf {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:35 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-225f779f-e5f8-4e5f-b593-8fbccb0615bf Jul 06 15:39:35 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5952739e-e79e-4a70-9764-3c1be9ff62f6 tempest-ProjectReaderTests-741168160 None] Acquiring lock "cinder-5fd45e16-323c-4375-88f7-3afbbf669d43-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5952739e-e79e-4a70-9764-3c1be9ff62f6 tempest-ProjectReaderTests-741168160 None] Lock "cinder-5fd45e16-323c-4375-88f7-3afbbf669d43-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5952739e-e79e-4a70-9764-3c1be9ff62f6 tempest-ProjectReaderTests-741168160 None] Acquiring lock "cinder-quobyte-5fd45e16-323c-4375-88f7-3afbbf669d43" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5952739e-e79e-4a70-9764-3c1be9ff62f6 tempest-ProjectReaderTests-741168160 None] Lock "cinder-quobyte-5fd45e16-323c-4375-88f7-3afbbf669d43" acquired by "delete_volume" :: waited 0.014s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:35 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a37613-dffb-4fa7-a6b5-ffb07f9244e9]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5952739e-e79e-4a70-9764-3c1be9ff62f6 tempest-ProjectReaderTests-741168160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5fd45e16-323c-4375-88f7-3afbbf669d43 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:35 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5fd45e16-323c-4375-88f7-3afbbf669d43 Jul 06 15:39:35 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:36 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d2f726ef-08e1-4f34-a7b0-a85e1df9f597 tempest-VolumesTransfersV357Test-1874424773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2ddac76b-23a1-4ff3-8964-4344054d45a9" returned: 0 in 0.810s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d2f726ef-08e1-4f34-a7b0-a85e1df9f597 tempest-VolumesTransfersV357Test-1874424773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2ddac76b-23a1-4ff3-8964-4344054d45a9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:36 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1dcdad35-0c3f-49ff-99da-1029477413c5 tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-225f779f-e5f8-4e5f-b593-8fbccb0615bf" returned: 0 in 0.698s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1dcdad35-0c3f-49ff-99da-1029477413c5 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-quobyte-225f779f-e5f8-4e5f-b593-8fbccb0615bf" released by "delete_volume" :: held 1.591s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:36 devstack sudo[100987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2ddac76b-23a1-4ff3-8964-4344054d45a9 Jul 06 15:39:36 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-1dcdad35-0c3f-49ff-99da-1029477413c5 tempest-CreateVolumesFromSnapshotTest-781471547 None] Created reservations ['8d9a014b-d66c-4806-ad8d-2d005ea3546c', 'e83825b6-1259-40d8-ae40-026f98443a75', 'f37e5988-4454-41be-af3e-6f4cc9d689dd', 'a4d6aed9-8cc1-467b-a480-666a0a842b63'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1dcdad35-0c3f-49ff-99da-1029477413c5 tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1dcdad35-0c3f-49ff-99da-1029477413c5 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1dcdad35-0c3f-49ff-99da-1029477413c5 tempest-CreateVolumesFromSnapshotTest-781471547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1dcdad35-0c3f-49ff-99da-1029477413c5 tempest-CreateVolumesFromSnapshotTest-781471547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1dcdad35-0c3f-49ff-99da-1029477413c5 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1dcdad35-0c3f-49ff-99da-1029477413c5 tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:36 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:39:36 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:36 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5952739e-e79e-4a70-9764-3c1be9ff62f6 tempest-ProjectReaderTests-741168160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5fd45e16-323c-4375-88f7-3afbbf669d43" returned: 0 in 0.788s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5952739e-e79e-4a70-9764-3c1be9ff62f6 tempest-ProjectReaderTests-741168160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5fd45e16-323c-4375-88f7-3afbbf669d43 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:36 devstack sudo[100994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5fd45e16-323c-4375-88f7-3afbbf669d43 Jul 06 15:39:36 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a33859af-989b-4086-879a-a985f4a8d025 tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "cinder-1f648ed4-3a50-488a-9ea8-3d4a6e6fccfa-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a33859af-989b-4086-879a-a985f4a8d025 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-1f648ed4-3a50-488a-9ea8-3d4a6e6fccfa-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a33859af-989b-4086-879a-a985f4a8d025 tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "cinder-quobyte-1f648ed4-3a50-488a-9ea8-3d4a6e6fccfa" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a33859af-989b-4086-879a-a985f4a8d025 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-quobyte-1f648ed4-3a50-488a-9ea8-3d4a6e6fccfa" acquired by "delete_volume" :: waited 0.024s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:36 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[afad3591-b56f-4366-84b0-56f2ae0a9372]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a33859af-989b-4086-879a-a985f4a8d025 tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1f648ed4-3a50-488a-9ea8-3d4a6e6fccfa {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d2f726ef-08e1-4f34-a7b0-a85e1df9f597 tempest-VolumesTransfersV357Test-1874424773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2ddac76b-23a1-4ff3-8964-4344054d45a9" returned: 0 in 0.773s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d2f726ef-08e1-4f34-a7b0-a85e1df9f597 tempest-VolumesTransfersV357Test-1874424773 None] Lock "cinder-quobyte-2ddac76b-23a1-4ff3-8964-4344054d45a9" released by "delete_volume" :: held 1.630s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-d2f726ef-08e1-4f34-a7b0-a85e1df9f597 tempest-VolumesTransfersV357Test-1874424773 None] Created reservations ['95dfba50-a6ec-472f-a3ae-7e2ce3bc2ddc', 'b8e3a4a6-1846-4c97-a0ce-1e06c0377206', 'b4a7feea-925c-43f5-8b6d-723f013a6173', '0a5047d2-4292-4247-8b68-b66ac74f627e'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=147,cinder:INSERT=40,cinder:UPDATE=173,cinder:DELETE=13 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=130,cinder:INSERT=48,cinder:UPDATE=189,cinder:DELETE=20 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d2f726ef-08e1-4f34-a7b0-a85e1df9f597 tempest-VolumesTransfersV357Test-1874424773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d2f726ef-08e1-4f34-a7b0-a85e1df9f597 tempest-VolumesTransfersV357Test-1874424773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d2f726ef-08e1-4f34-a7b0-a85e1df9f597 tempest-VolumesTransfersV357Test-1874424773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:36 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d2f726ef-08e1-4f34-a7b0-a85e1df9f597 tempest-VolumesTransfersV357Test-1874424773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d2f726ef-08e1-4f34-a7b0-a85e1df9f597 tempest-VolumesTransfersV357Test-1874424773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d2f726ef-08e1-4f34-a7b0-a85e1df9f597 tempest-VolumesTransfersV357Test-1874424773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1dcdad35-0c3f-49ff-99da-1029477413c5 tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.813s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:36 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-1dcdad35-0c3f-49ff-99da-1029477413c5 tempest-CreateVolumesFromSnapshotTest-781471547 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:37 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1f648ed4-3a50-488a-9ea8-3d4a6e6fccfa Jul 06 15:39:37 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:37 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-1dcdad35-0c3f-49ff-99da-1029477413c5 tempest-CreateVolumesFromSnapshotTest-781471547 None] Deleted volume successfully. Jul 06 15:39:37 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:39:37 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:37 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1dcdad35-0c3f-49ff-99da-1029477413c5 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-225f779f-e5f8-4e5f-b593-8fbccb0615bf-delete_volume" released by "delete_volume" :: held 2.637s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:37 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5952739e-e79e-4a70-9764-3c1be9ff62f6 tempest-ProjectReaderTests-741168160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5fd45e16-323c-4375-88f7-3afbbf669d43" returned: 0 in 0.842s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:37 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5952739e-e79e-4a70-9764-3c1be9ff62f6 tempest-ProjectReaderTests-741168160 None] Lock "cinder-quobyte-5fd45e16-323c-4375-88f7-3afbbf669d43" released by "delete_volume" :: held 1.682s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:37 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-5952739e-e79e-4a70-9764-3c1be9ff62f6 tempest-ProjectReaderTests-741168160 None] Created reservations ['c5c8d006-0746-4ba5-9d2d-3ec2577d0ab8', 'decb6a11-e7f8-4bc1-bccd-e678eef06ade', '214fb8db-0f2f-49db-884a-98184a99c824', '418dd497-c079-4299-ad5e-343f38298bbb'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5952739e-e79e-4a70-9764-3c1be9ff62f6 tempest-ProjectReaderTests-741168160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5952739e-e79e-4a70-9764-3c1be9ff62f6 tempest-ProjectReaderTests-741168160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5952739e-e79e-4a70-9764-3c1be9ff62f6 tempest-ProjectReaderTests-741168160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5952739e-e79e-4a70-9764-3c1be9ff62f6 tempest-ProjectReaderTests-741168160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5952739e-e79e-4a70-9764-3c1be9ff62f6 tempest-ProjectReaderTests-741168160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5952739e-e79e-4a70-9764-3c1be9ff62f6 tempest-ProjectReaderTests-741168160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:37 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:39:37 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:37 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a33859af-989b-4086-879a-a985f4a8d025 tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1f648ed4-3a50-488a-9ea8-3d4a6e6fccfa" returned: 0 in 1.005s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a33859af-989b-4086-879a-a985f4a8d025 tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1f648ed4-3a50-488a-9ea8-3d4a6e6fccfa {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:37 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1f648ed4-3a50-488a-9ea8-3d4a6e6fccfa Jul 06 15:39:37 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:37 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d2f726ef-08e1-4f34-a7b0-a85e1df9f597 tempest-VolumesTransfersV357Test-1874424773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.023s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-d2f726ef-08e1-4f34-a7b0-a85e1df9f597 tempest-VolumesTransfersV357Test-1874424773 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:38 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-d2f726ef-08e1-4f34-a7b0-a85e1df9f597 tempest-VolumesTransfersV357Test-1874424773 None] Deleted volume successfully. Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d2f726ef-08e1-4f34-a7b0-a85e1df9f597 tempest-VolumesTransfersV357Test-1874424773 None] Lock "cinder-2ddac76b-23a1-4ff3-8964-4344054d45a9-delete_volume" released by "delete_volume" :: held 2.908s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Flow 'volume_create_manager' (a4060e58-f917-489a-b4cf-cca137255408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5962966e-c0c4-4519-8ee2-7915e875179b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5962966e-c0c4-4519-8ee2-7915e875179b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1741941819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb3319b4-7947-49dc-a6db-43e818a102a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d0d20421454ebfbc68846618bdc158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:38Z,use_quota=True,user_id='b004f33515344ee2bb21bd794bdda03d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e5b966-e2a9-4896-9b5c-f46e6669dace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e5b966-e2a9-4896-9b5c-f46e6669dace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a75a6de-274f-49b0-a6db-8ac608b2713b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a75a6de-274f-49b0-a6db-8ac608b2713b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb3319b4-7947-49dc-a6db-43e818a102a9', 'volume_name': 'volume-bb3319b4-7947-49dc-a6db-43e818a102a9', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fdafd7d-e04f-454a-b703-0c93a3e7df02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fdafd7d-e04f-454a-b703-0c93a3e7df02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1921384-6a70-4444-b00b-18c2af485b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:38 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Volume bb3319b4-7947-49dc-a6db-43e818a102a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb3319b4-7947-49dc-a6db-43e818a102a9', 'volume_size': 1} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1741941819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb3319b4-7947-49dc-a6db-43e818a102a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d0d20421454ebfbc68846618bdc158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:38Z,use_quota=True,user_id='b004f33515344ee2bb21bd794bdda03d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Creating volume bb3319b4-7947-49dc-a6db-43e818a102a9 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:39:38 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bb3319b4-7947-49dc-a6db-43e818a102a9 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:38 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bb3319b4-7947-49dc-a6db-43e818a102a9 1073741824 Jul 06 15:39:38 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:38 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5952739e-e79e-4a70-9764-3c1be9ff62f6 tempest-ProjectReaderTests-741168160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.046s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-5952739e-e79e-4a70-9764-3c1be9ff62f6 tempest-ProjectReaderTests-741168160 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:38 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-5952739e-e79e-4a70-9764-3c1be9ff62f6 tempest-ProjectReaderTests-741168160 None] Deleted volume successfully. Jul 06 15:39:38 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:39:38 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5952739e-e79e-4a70-9764-3c1be9ff62f6 tempest-ProjectReaderTests-741168160 None] Lock "cinder-5fd45e16-323c-4375-88f7-3afbbf669d43-delete_volume" released by "delete_volume" :: held 3.089s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Flow 'volume_create_manager' (55fdedfb-78e1-4015-a498-265d5a7135c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a57d935d-8d13-4098-bb74-814546027c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a57d935d-8d13-4098-bb74-814546027c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1240856640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=496b4fd3-678e-4754-ad30-62a2df530141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e84c538490d490faf2b2e446b219fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:39Z,use_quota=True,user_id='9b1dee45c227471fb4fee38a96d8e5fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba2dc6c-5955-403b-a6b3-a30ef0603bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba2dc6c-5955-403b-a6b3-a30ef0603bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da03ba89-42fb-466c-9692-d3ccf357463b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da03ba89-42fb-466c-9692-d3ccf357463b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '496b4fd3-678e-4754-ad30-62a2df530141', 'volume_name': 'volume-496b4fd3-678e-4754-ad30-62a2df530141', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:38 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e753ceaf-b0d3-4650-833c-a0e084b0de50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e753ceaf-b0d3-4650-833c-a0e084b0de50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f0d5908-0a66-469a-87b8-0393a8720476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:38 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Volume 496b4fd3-678e-4754-ad30-62a2df530141: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-496b4fd3-678e-4754-ad30-62a2df530141', 'volume_size': 1} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a33859af-989b-4086-879a-a985f4a8d025 tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1f648ed4-3a50-488a-9ea8-3d4a6e6fccfa" returned: 0 in 1.024s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a33859af-989b-4086-879a-a985f4a8d025 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-quobyte-1f648ed4-3a50-488a-9ea8-3d4a6e6fccfa" released by "delete_volume" :: held 2.103s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-a33859af-989b-4086-879a-a985f4a8d025 tempest-CreateVolumesFromSnapshotTest-781471547 None] Created reservations ['ce146ecd-3671-4a08-b32f-893ea927442a', '1b2209f8-035f-41e8-ba18-4b0f34cd1c87', 'd3bd4283-ec96-441f-a795-b7ebb6a241ef', '3d8ed372-3948-4c26-95ce-0f225c594ff4'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a33859af-989b-4086-879a-a985f4a8d025 tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a33859af-989b-4086-879a-a985f4a8d025 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a33859af-989b-4086-879a-a985f4a8d025 tempest-CreateVolumesFromSnapshotTest-781471547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a33859af-989b-4086-879a-a985f4a8d025 tempest-CreateVolumesFromSnapshotTest-781471547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a33859af-989b-4086-879a-a985f4a8d025 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a33859af-989b-4086-879a-a985f4a8d025 tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:39 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:39:39 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:39 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-0d23de1d-b21d-4e75-bbee-1e66317dad08 tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "cinder-e9f3cff6-7877-4691-bcb8-11a6ebeb998a-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:39 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-0d23de1d-b21d-4e75-bbee-1e66317dad08 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-e9f3cff6-7877-4691-bcb8-11a6ebeb998a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:39 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.965s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:39 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager._thread_info {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:39:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread count: 28 {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:39:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread info: [<_MainThread(MainThread, started 124857273856128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:39:39 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-0d23de1d-b21d-4e75-bbee-1e66317dad08 tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "cinder-quobyte-e9f3cff6-7877-4691-bcb8-11a6ebeb998a" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:39 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-0d23de1d-b21d-4e75-bbee-1e66317dad08 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-quobyte-e9f3cff6-7877-4691-bcb8-11a6ebeb998a" acquired by "delete_volume" :: waited 0.020s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:39 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ceda0d6-ab27-4ad6-9172-aaebd585f714]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0d23de1d-b21d-4e75-bbee-1e66317dad08 tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e9f3cff6-7877-4691-bcb8-11a6ebeb998a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:39 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bb3319b4-7947-49dc-a6db-43e818a102a9 1073741824" returned: 0 in 1.125s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bb3319b4-7947-49dc-a6db-43e818a102a9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:39 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bb3319b4-7947-49dc-a6db-43e818a102a9 Jul 06 15:39:39 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:39 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e9f3cff6-7877-4691-bcb8-11a6ebeb998a Jul 06 15:39:39 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:39 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a33859af-989b-4086-879a-a985f4a8d025 tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.783s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-a33859af-989b-4086-879a-a985f4a8d025 tempest-CreateVolumesFromSnapshotTest-781471547 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:39 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a33859af-989b-4086-879a-a985f4a8d025 tempest-CreateVolumesFromSnapshotTest-781471547 None] Deleted volume successfully. Jul 06 15:39:39 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a33859af-989b-4086-879a-a985f4a8d025 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-1f648ed4-3a50-488a-9ea8-3d4a6e6fccfa-delete_volume" released by "delete_volume" :: held 3.141s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:40 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bb3319b4-7947-49dc-a6db-43e818a102a9" returned: 0 in 0.689s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:39:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.511s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1240856640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=496b4fd3-678e-4754-ad30-62a2df530141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e84c538490d490faf2b2e446b219fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:39Z,use_quota=True,user_id='9b1dee45c227471fb4fee38a96d8e5fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:39:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Creating volume 496b4fd3-678e-4754-ad30-62a2df530141 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:39:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:39:40 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:39:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-496b4fd3-678e-4754-ad30-62a2df530141 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1921384-6a70-4444-b00b-18c2af485b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb3319b4-7947-49dc-a6db-43e818a102a9', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:40 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-496b4fd3-678e-4754-ad30-62a2df530141 1073741824 Jul 06 15:39:40 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2603041-c856-4620-a021-f7f5a813e895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:40 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:40 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Volume volume-bb3319b4-7947-49dc-a6db-43e818a102a9 (bb3319b4-7947-49dc-a6db-43e818a102a9): created successfully Jul 06 15:39:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2603041-c856-4620-a021-f7f5a813e895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Flow 'volume_create_manager' (a4060e58-f917-489a-b4cf-cca137255408) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0d23de1d-b21d-4e75-bbee-1e66317dad08 tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e9f3cff6-7877-4691-bcb8-11a6ebeb998a" returned: 0 in 0.870s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0d23de1d-b21d-4e75-bbee-1e66317dad08 tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e9f3cff6-7877-4691-bcb8-11a6ebeb998a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:40 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-0f7f7008-a0b7-41c9-9adc-dead2aec9efe tempest-VolumesTransfersV357Test-1048002472 None] Created volume successfully. Jul 06 15:39:40 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e9f3cff6-7877-4691-bcb8-11a6ebeb998a Jul 06 15:39:40 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:40 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-193977a7-3c4c-4e89-928f-4020c1f6b290 tempest-VolumesTransfersV357Test-1874424773 None] Acquiring lock "cinder-bb3319b4-7947-49dc-a6db-43e818a102a9-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:40 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-193977a7-3c4c-4e89-928f-4020c1f6b290 tempest-VolumesTransfersV357Test-1874424773 None] Lock "cinder-bb3319b4-7947-49dc-a6db-43e818a102a9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:40 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-193977a7-3c4c-4e89-928f-4020c1f6b290 tempest-VolumesTransfersV357Test-1874424773 None] Acquiring lock "cinder-quobyte-bb3319b4-7947-49dc-a6db-43e818a102a9" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:40 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-193977a7-3c4c-4e89-928f-4020c1f6b290 tempest-VolumesTransfersV357Test-1874424773 None] Lock "cinder-quobyte-bb3319b4-7947-49dc-a6db-43e818a102a9" acquired by "delete_volume" :: waited 0.024s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:41 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0f7aa6-7297-4209-9646-69736f1417b7]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-193977a7-3c4c-4e89-928f-4020c1f6b290 tempest-VolumesTransfersV357Test-1874424773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bb3319b4-7947-49dc-a6db-43e818a102a9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:41 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bb3319b4-7947-49dc-a6db-43e818a102a9 Jul 06 15:39:41 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:41 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0d23de1d-b21d-4e75-bbee-1e66317dad08 tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e9f3cff6-7877-4691-bcb8-11a6ebeb998a" returned: 0 in 0.759s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-0d23de1d-b21d-4e75-bbee-1e66317dad08 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-quobyte-e9f3cff6-7877-4691-bcb8-11a6ebeb998a" released by "delete_volume" :: held 1.673s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:41 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-0d23de1d-b21d-4e75-bbee-1e66317dad08 tempest-CreateVolumesFromSnapshotTest-781471547 None] Created reservations ['74e2adec-0543-42b7-b87c-f2383c5ecc51', '164c20be-722e-4382-862f-a823dbaebc9b', 'a55b1c23-ebb3-4857-94ea-63340dfdbdac', '7db6db1d-0357-4014-a528-2279d72ab95f'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:41 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0d23de1d-b21d-4e75-bbee-1e66317dad08 tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0d23de1d-b21d-4e75-bbee-1e66317dad08 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:41 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0d23de1d-b21d-4e75-bbee-1e66317dad08 tempest-CreateVolumesFromSnapshotTest-781471547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:41 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0d23de1d-b21d-4e75-bbee-1e66317dad08 tempest-CreateVolumesFromSnapshotTest-781471547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0d23de1d-b21d-4e75-bbee-1e66317dad08 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0d23de1d-b21d-4e75-bbee-1e66317dad08 tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-496b4fd3-678e-4754-ad30-62a2df530141 1073741824" returned: 0 in 1.015s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:41 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:39:41 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-496b4fd3-678e-4754-ad30-62a2df530141 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:41 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-496b4fd3-678e-4754-ad30-62a2df530141 Jul 06 15:39:41 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a1a94943-5577-4302-b7ec-ff4dadd7689b tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "cinder-790ac4ca-5098-4c10-a195-85ad12b5d50b-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a1a94943-5577-4302-b7ec-ff4dadd7689b tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-790ac4ca-5098-4c10-a195-85ad12b5d50b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a1a94943-5577-4302-b7ec-ff4dadd7689b tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "cinder-quobyte-790ac4ca-5098-4c10-a195-85ad12b5d50b" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a1a94943-5577-4302-b7ec-ff4dadd7689b tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-quobyte-790ac4ca-5098-4c10-a195-85ad12b5d50b" acquired by "delete_volume" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:41 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe1bbc3-560c-4a71-afc6-8c091454e620]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a1a94943-5577-4302-b7ec-ff4dadd7689b tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-790ac4ca-5098-4c10-a195-85ad12b5d50b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:41 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-193977a7-3c4c-4e89-928f-4020c1f6b290 tempest-VolumesTransfersV357Test-1874424773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bb3319b4-7947-49dc-a6db-43e818a102a9" returned: 0 in 0.909s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-193977a7-3c4c-4e89-928f-4020c1f6b290 tempest-VolumesTransfersV357Test-1874424773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bb3319b4-7947-49dc-a6db-43e818a102a9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:41 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bb3319b4-7947-49dc-a6db-43e818a102a9 Jul 06 15:39:41 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:42 devstack sudo[101085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-790ac4ca-5098-4c10-a195-85ad12b5d50b Jul 06 15:39:42 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:42 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-496b4fd3-678e-4754-ad30-62a2df530141" returned: 0 in 0.783s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:42 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:39:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f0d5908-0a66-469a-87b8-0393a8720476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-496b4fd3-678e-4754-ad30-62a2df530141', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84fc4bf8-a95c-414d-bbe1-a78b7772cb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:42 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Volume volume-496b4fd3-678e-4754-ad30-62a2df530141 (496b4fd3-678e-4754-ad30-62a2df530141): created successfully Jul 06 15:39:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84fc4bf8-a95c-414d-bbe1-a78b7772cb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Flow 'volume_create_manager' (55fdedfb-78e1-4015-a498-265d5a7135c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:42 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-24d06828-18d1-46c8-9de9-5e7504694bd6 tempest-ProjectReaderTests-741168160 None] Created volume successfully. Jul 06 15:39:42 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0d23de1d-b21d-4e75-bbee-1e66317dad08 tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.974s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:42 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-0d23de1d-b21d-4e75-bbee-1e66317dad08 tempest-CreateVolumesFromSnapshotTest-781471547 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:42 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-0d23de1d-b21d-4e75-bbee-1e66317dad08 tempest-CreateVolumesFromSnapshotTest-781471547 None] Deleted volume successfully. Jul 06 15:39:42 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-0d23de1d-b21d-4e75-bbee-1e66317dad08 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-e9f3cff6-7877-4691-bcb8-11a6ebeb998a-delete_volume" released by "delete_volume" :: held 2.945s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:42 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-193977a7-3c4c-4e89-928f-4020c1f6b290 tempest-VolumesTransfersV357Test-1874424773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-bb3319b4-7947-49dc-a6db-43e818a102a9" returned: 0 in 0.769s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:42 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-193977a7-3c4c-4e89-928f-4020c1f6b290 tempest-VolumesTransfersV357Test-1874424773 None] Lock "cinder-quobyte-bb3319b4-7947-49dc-a6db-43e818a102a9" released by "delete_volume" :: held 1.727s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:42 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-b2a6414f-36d0-43f1-90e9-72b5d6447a3c req-8d901bb9-a839-4956-ba39-3cedaba9c180 tempest-TestInstancesWithCinderVolumes-396084605 None] Terminate volume connection completed successfully. Jul 06 15:39:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-b2a6414f-36d0-43f1-90e9-72b5d6447a3c req-8d901bb9-a839-4956-ba39-3cedaba9c180 tempest-TestInstancesWithCinderVolumes-396084605 None] Deleting attachment b86e5576-a298-4178-9e31-4fbc21ef0344. {{(pid=86148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:39:42 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-193977a7-3c4c-4e89-928f-4020c1f6b290 tempest-VolumesTransfersV357Test-1874424773 None] Created reservations ['bbdcdac6-5529-41f0-a6f1-eb16084f97ee', '8026a1ad-7ae9-48c5-86cd-c06be58d9ba7', '3ce3fb7d-34c1-4619-b215-2d8a1f1e5dc8', '57043f8a-e8a4-4cb3-87d3-fe0d5f3d57f7'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-193977a7-3c4c-4e89-928f-4020c1f6b290 tempest-VolumesTransfersV357Test-1874424773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-193977a7-3c4c-4e89-928f-4020c1f6b290 tempest-VolumesTransfersV357Test-1874424773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:42 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-193977a7-3c4c-4e89-928f-4020c1f6b290 tempest-VolumesTransfersV357Test-1874424773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:42 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-193977a7-3c4c-4e89-928f-4020c1f6b290 tempest-VolumesTransfersV357Test-1874424773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-193977a7-3c4c-4e89-928f-4020c1f6b290 tempest-VolumesTransfersV357Test-1874424773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-193977a7-3c4c-4e89-928f-4020c1f6b290 tempest-VolumesTransfersV357Test-1874424773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:42 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a1a94943-5577-4302-b7ec-ff4dadd7689b tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-790ac4ca-5098-4c10-a195-85ad12b5d50b" returned: 0 in 1.004s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a1a94943-5577-4302-b7ec-ff4dadd7689b tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-790ac4ca-5098-4c10-a195-85ad12b5d50b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:42 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:39:42 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:42 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-790ac4ca-5098-4c10-a195-85ad12b5d50b Jul 06 15:39:42 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f3d614cb-1445-4d9f-a4d6-0d925564932d tempest-ProjectReaderTests-741168160 None] Acquiring lock "cinder-496b4fd3-678e-4754-ad30-62a2df530141-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f3d614cb-1445-4d9f-a4d6-0d925564932d tempest-ProjectReaderTests-741168160 None] Lock "cinder-496b4fd3-678e-4754-ad30-62a2df530141-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f3d614cb-1445-4d9f-a4d6-0d925564932d tempest-ProjectReaderTests-741168160 None] Acquiring lock "cinder-quobyte-496b4fd3-678e-4754-ad30-62a2df530141" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f3d614cb-1445-4d9f-a4d6-0d925564932d tempest-ProjectReaderTests-741168160 None] Lock "cinder-quobyte-496b4fd3-678e-4754-ad30-62a2df530141" acquired by "delete_volume" :: waited 0.028s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:43 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f45adf8-a3b9-4044-9e8a-fe9f8c3f2732]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f3d614cb-1445-4d9f-a4d6-0d925564932d tempest-ProjectReaderTests-741168160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-496b4fd3-678e-4754-ad30-62a2df530141 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:43 devstack sudo[101137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-496b4fd3-678e-4754-ad30-62a2df530141 Jul 06 15:39:43 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:43 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a1a94943-5577-4302-b7ec-ff4dadd7689b tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-790ac4ca-5098-4c10-a195-85ad12b5d50b" returned: 0 in 0.786s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a1a94943-5577-4302-b7ec-ff4dadd7689b tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-quobyte-790ac4ca-5098-4c10-a195-85ad12b5d50b" released by "delete_volume" :: held 1.849s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:43 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-193977a7-3c4c-4e89-928f-4020c1f6b290 tempest-VolumesTransfersV357Test-1874424773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.874s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:43 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-193977a7-3c4c-4e89-928f-4020c1f6b290 tempest-VolumesTransfersV357Test-1874424773 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:43 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-a1a94943-5577-4302-b7ec-ff4dadd7689b tempest-CreateVolumesFromSnapshotTest-781471547 None] Created reservations ['bedc869e-6348-44b4-a77d-b584a9897b6d', '57813f08-919e-4fbb-81bf-42025818a9a3', '0ce79c31-2e37-459e-89a7-36ce9a608d99', 'e2eb6716-5797-4cd3-aa93-a875055c0755'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:43 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-193977a7-3c4c-4e89-928f-4020c1f6b290 tempest-VolumesTransfersV357Test-1874424773 None] Deleted volume successfully. Jul 06 15:39:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-193977a7-3c4c-4e89-928f-4020c1f6b290 tempest-VolumesTransfersV357Test-1874424773 None] Lock "cinder-bb3319b4-7947-49dc-a6db-43e818a102a9-delete_volume" released by "delete_volume" :: held 2.862s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a1a94943-5577-4302-b7ec-ff4dadd7689b tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a1a94943-5577-4302-b7ec-ff4dadd7689b tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:43 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a1a94943-5577-4302-b7ec-ff4dadd7689b tempest-CreateVolumesFromSnapshotTest-781471547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:43 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a1a94943-5577-4302-b7ec-ff4dadd7689b tempest-CreateVolumesFromSnapshotTest-781471547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a1a94943-5577-4302-b7ec-ff4dadd7689b tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a1a94943-5577-4302-b7ec-ff4dadd7689b tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:43 devstack sudo[101141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:39:43 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c40e3b61-8216-43a7-a38d-58fbc1a942ea tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "cinder-f02896b9-9f2f-4b71-be73-b5f78119164f-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c40e3b61-8216-43a7-a38d-58fbc1a942ea tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-f02896b9-9f2f-4b71-be73-b5f78119164f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c40e3b61-8216-43a7-a38d-58fbc1a942ea tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "cinder-quobyte-f5cce599-b566-49ec-963a-7829ff3f0e81" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c40e3b61-8216-43a7-a38d-58fbc1a942ea tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-quobyte-f5cce599-b566-49ec-963a-7829ff3f0e81" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c40e3b61-8216-43a7-a38d-58fbc1a942ea tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "cinder-quobyte-f02896b9-9f2f-4b71-be73-b5f78119164f" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c40e3b61-8216-43a7-a38d-58fbc1a942ea tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-quobyte-f02896b9-9f2f-4b71-be73-b5f78119164f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-c40e3b61-8216-43a7-a38d-58fbc1a942ea tempest-CreateVolumesFromSnapshotTest-781471547 None] Deleting offline snapshot f02896b9-9f2f-4b71-be73-b5f78119164f of volume f5cce599-b566-49ec-963a-7829ff3f0e81 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:39:44 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-c40e3b61-8216-43a7-a38d-58fbc1a942ea tempest-CreateVolumesFromSnapshotTest-781471547 None] snapshot_file for this snap is: volume-f5cce599-b566-49ec-963a-7829ff3f0e81.f02896b9-9f2f-4b71-be73-b5f78119164f {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:39:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f3d614cb-1445-4d9f-a4d6-0d925564932d tempest-ProjectReaderTests-741168160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-496b4fd3-678e-4754-ad30-62a2df530141" returned: 0 in 0.955s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f3d614cb-1445-4d9f-a4d6-0d925564932d tempest-ProjectReaderTests-741168160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-496b4fd3-678e-4754-ad30-62a2df530141 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:44 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bc2ed6-957d-4be6-9db1-ef10f19a0c31]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c40e3b61-8216-43a7-a38d-58fbc1a942ea tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81.f02896b9-9f2f-4b71-be73-b5f78119164f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:44 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-496b4fd3-678e-4754-ad30-62a2df530141 Jul 06 15:39:44 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:44 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81.f02896b9-9f2f-4b71-be73-b5f78119164f Jul 06 15:39:44 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:44 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a1a94943-5577-4302-b7ec-ff4dadd7689b tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.855s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:44 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-a1a94943-5577-4302-b7ec-ff4dadd7689b tempest-CreateVolumesFromSnapshotTest-781471547 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:44 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a1a94943-5577-4302-b7ec-ff4dadd7689b tempest-CreateVolumesFromSnapshotTest-781471547 None] Deleted volume successfully. Jul 06 15:39:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a1a94943-5577-4302-b7ec-ff4dadd7689b tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-790ac4ca-5098-4c10-a195-85ad12b5d50b-delete_volume" released by "delete_volume" :: held 2.993s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-bd30f7c7-239f-421f-954f-a5b042b1fa25 tempest-TestInstancesWithCinderVolumes-396084605 None] Acquiring lock "cinder-f0144b92-8dbd-4d3e-ac95-9356d32968eb-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-bd30f7c7-239f-421f-954f-a5b042b1fa25 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "cinder-f0144b92-8dbd-4d3e-ac95-9356d32968eb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-bd30f7c7-239f-421f-954f-a5b042b1fa25 tempest-TestInstancesWithCinderVolumes-396084605 None] Acquiring lock "cinder-quobyte-f0144b92-8dbd-4d3e-ac95-9356d32968eb" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-bd30f7c7-239f-421f-954f-a5b042b1fa25 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "cinder-quobyte-f0144b92-8dbd-4d3e-ac95-9356d32968eb" acquired by "delete_volume" :: waited 0.029s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:44 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6e3250-1018-4d80-9262-01611942fe9d]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd30f7c7-239f-421f-954f-a5b042b1fa25 tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f0144b92-8dbd-4d3e-ac95-9356d32968eb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:44 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f3d614cb-1445-4d9f-a4d6-0d925564932d tempest-ProjectReaderTests-741168160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-496b4fd3-678e-4754-ad30-62a2df530141" returned: 0 in 0.853s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:45 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f3d614cb-1445-4d9f-a4d6-0d925564932d tempest-ProjectReaderTests-741168160 None] Lock "cinder-quobyte-496b4fd3-678e-4754-ad30-62a2df530141" released by "delete_volume" :: held 1.865s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:45 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-f3d614cb-1445-4d9f-a4d6-0d925564932d tempest-ProjectReaderTests-741168160 None] Created reservations ['5ba31696-015c-48e0-864a-fb83bba0c6ce', '18a42a24-c3eb-4514-a575-fe422d27a44a', '4e58f357-695e-43ad-96ee-956f24af38bd', 'cd5cab1e-fad7-49d8-a45c-da70969b7ce5'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:45 devstack sudo[101158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f0144b92-8dbd-4d3e-ac95-9356d32968eb Jul 06 15:39:45 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f3d614cb-1445-4d9f-a4d6-0d925564932d tempest-ProjectReaderTests-741168160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f3d614cb-1445-4d9f-a4d6-0d925564932d tempest-ProjectReaderTests-741168160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f3d614cb-1445-4d9f-a4d6-0d925564932d tempest-ProjectReaderTests-741168160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f3d614cb-1445-4d9f-a4d6-0d925564932d tempest-ProjectReaderTests-741168160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f3d614cb-1445-4d9f-a4d6-0d925564932d tempest-ProjectReaderTests-741168160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f3d614cb-1445-4d9f-a4d6-0d925564932d tempest-ProjectReaderTests-741168160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:45 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:39:45 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:45 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c40e3b61-8216-43a7-a38d-58fbc1a942ea tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81.f02896b9-9f2f-4b71-be73-b5f78119164f" returned: 0 in 1.099s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-c40e3b61-8216-43a7-a38d-58fbc1a942ea tempest-CreateVolumesFromSnapshotTest-781471547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5cce599-b566-49ec-963a-7829ff3f0e81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:39:45 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cedb35c-7eef-4a65-bb4c-9ccb3fa1511d]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c40e3b61-8216-43a7-a38d-58fbc1a942ea tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:45 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81 Jul 06 15:39:45 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:46 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f3d614cb-1445-4d9f-a4d6-0d925564932d tempest-ProjectReaderTests-741168160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.115s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:46 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-f3d614cb-1445-4d9f-a4d6-0d925564932d tempest-ProjectReaderTests-741168160 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:46 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd30f7c7-239f-421f-954f-a5b042b1fa25 tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f0144b92-8dbd-4d3e-ac95-9356d32968eb" returned: 0 in 1.335s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd30f7c7-239f-421f-954f-a5b042b1fa25 tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f0144b92-8dbd-4d3e-ac95-9356d32968eb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:46 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-f3d614cb-1445-4d9f-a4d6-0d925564932d tempest-ProjectReaderTests-741168160 None] Deleted volume successfully. Jul 06 15:39:46 devstack sudo[101170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f0144b92-8dbd-4d3e-ac95-9356d32968eb Jul 06 15:39:46 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f3d614cb-1445-4d9f-a4d6-0d925564932d tempest-ProjectReaderTests-741168160 None] Lock "cinder-496b4fd3-678e-4754-ad30-62a2df530141-delete_volume" released by "delete_volume" :: held 3.317s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:46 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c40e3b61-8216-43a7-a38d-58fbc1a942ea tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81" returned: 0 in 1.415s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c40e3b61-8216-43a7-a38d-58fbc1a942ea tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81.f02896b9-9f2f-4b71-be73-b5f78119164f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:46 devstack sudo[101175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81.f02896b9-9f2f-4b71-be73-b5f78119164f Jul 06 15:39:46 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:47 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd30f7c7-239f-421f-954f-a5b042b1fa25 tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f0144b92-8dbd-4d3e-ac95-9356d32968eb" returned: 0 in 1.100s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:47 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-bd30f7c7-239f-421f-954f-a5b042b1fa25 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "cinder-quobyte-f0144b92-8dbd-4d3e-ac95-9356d32968eb" released by "delete_volume" :: held 2.519s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:47 devstack cinder-volume[86148]: WARNING cinder.quota [None req-bd30f7c7-239f-421f-954f-a5b042b1fa25 tempest-TestInstancesWithCinderVolumes-396084605 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1874361180-381412522 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1874361180-381412522, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:39:47 devstack cinder-volume[86148]: WARNING cinder.quota [None req-bd30f7c7-239f-421f-954f-a5b042b1fa25 tempest-TestInstancesWithCinderVolumes-396084605 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1874361180-381412522 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1874361180-381412522, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:39:47 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-bd30f7c7-239f-421f-954f-a5b042b1fa25 tempest-TestInstancesWithCinderVolumes-396084605 None] Created reservations ['4d86b5b9-267f-4430-ae57-addf23e90484', '7daacafe-6eff-4a15-a532-f16e604c530c', 'a4eae94c-db8f-4df8-85b5-c634ea0a7bdd', 'cf7a83f2-929f-4119-adf6-98cfcde722ea'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bd30f7c7-239f-421f-954f-a5b042b1fa25 tempest-TestInstancesWithCinderVolumes-396084605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bd30f7c7-239f-421f-954f-a5b042b1fa25 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:47 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-bd30f7c7-239f-421f-954f-a5b042b1fa25 tempest-TestInstancesWithCinderVolumes-396084605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:47 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-bd30f7c7-239f-421f-954f-a5b042b1fa25 tempest-TestInstancesWithCinderVolumes-396084605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bd30f7c7-239f-421f-954f-a5b042b1fa25 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd30f7c7-239f-421f-954f-a5b042b1fa25 tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:47 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:39:47 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:47 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c40e3b61-8216-43a7-a38d-58fbc1a942ea tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81.f02896b9-9f2f-4b71-be73-b5f78119164f" returned: 0 in 1.086s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c40e3b61-8216-43a7-a38d-58fbc1a942ea tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81.f02896b9-9f2f-4b71-be73-b5f78119164f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:47 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81.f02896b9-9f2f-4b71-be73-b5f78119164f Jul 06 15:39:47 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:48 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd30f7c7-239f-421f-954f-a5b042b1fa25 tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.949s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:48 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-bd30f7c7-239f-421f-954f-a5b042b1fa25 tempest-TestInstancesWithCinderVolumes-396084605 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:48 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-bd30f7c7-239f-421f-954f-a5b042b1fa25 tempest-TestInstancesWithCinderVolumes-396084605 None] Deleted volume successfully. Jul 06 15:39:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-bd30f7c7-239f-421f-954f-a5b042b1fa25 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "cinder-f0144b92-8dbd-4d3e-ac95-9356d32968eb-delete_volume" released by "delete_volume" :: held 3.843s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:49 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c40e3b61-8216-43a7-a38d-58fbc1a942ea tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81.f02896b9-9f2f-4b71-be73-b5f78119164f" returned: 0 in 1.218s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:49 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c40e3b61-8216-43a7-a38d-58fbc1a942ea tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-quobyte-f02896b9-9f2f-4b71-be73-b5f78119164f" released by "_delete_snapshot" :: held 5.007s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:49 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c40e3b61-8216-43a7-a38d-58fbc1a942ea tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-quobyte-f5cce599-b566-49ec-963a-7829ff3f0e81" released by "delete_snapshot" :: held 5.037s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:49 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-c40e3b61-8216-43a7-a38d-58fbc1a942ea tempest-CreateVolumesFromSnapshotTest-781471547 None] Created reservations ['4e8d77cf-e9f4-456f-a74c-0df958ba7275', 'e42de39b-2393-4f02-8ae5-9682830bc2d9', '37951ab4-6a06-4ac5-ae06-ff52ab49d470', '9b838cbe-a2a2-43e0-b79b-f35b23498a72'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:49 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-c40e3b61-8216-43a7-a38d-58fbc1a942ea tempest-CreateVolumesFromSnapshotTest-781471547 None] Delete snapshot completed successfully. Jul 06 15:39:49 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c40e3b61-8216-43a7-a38d-58fbc1a942ea tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-f02896b9-9f2f-4b71-be73-b5f78119164f-delete_snapshot" released by "delete_snapshot" :: held 5.255s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:49 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fa44e9c2-f2cf-441c-b9b4-82b14d30eb53 tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "cinder-f5cce599-b566-49ec-963a-7829ff3f0e81-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:49 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fa44e9c2-f2cf-441c-b9b4-82b14d30eb53 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-f5cce599-b566-49ec-963a-7829ff3f0e81-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:49 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fa44e9c2-f2cf-441c-b9b4-82b14d30eb53 tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "cinder-quobyte-f5cce599-b566-49ec-963a-7829ff3f0e81" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:49 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fa44e9c2-f2cf-441c-b9b4-82b14d30eb53 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-quobyte-f5cce599-b566-49ec-963a-7829ff3f0e81" acquired by "delete_volume" :: waited 0.015s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:49 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[403ffa0f-6799-4ae7-b7b7-1acf5e9db617]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fa44e9c2-f2cf-441c-b9b4-82b14d30eb53 tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:49 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81 Jul 06 15:39:49 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:50 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fa44e9c2-f2cf-441c-b9b4-82b14d30eb53 tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81" returned: 0 in 0.873s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fa44e9c2-f2cf-441c-b9b4-82b14d30eb53 tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:50 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81 Jul 06 15:39:50 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:50 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-e2a2d274-3fda-41b3-834f-e961532aaef9 req-47edd247-a2e7-4fde-b601-496d00854e7f tempest-TestInstancesWithCinderVolumes-396084605 None] Terminate volume connection completed successfully. Jul 06 15:39:50 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-e2a2d274-3fda-41b3-834f-e961532aaef9 req-47edd247-a2e7-4fde-b601-496d00854e7f tempest-TestInstancesWithCinderVolumes-396084605 None] Deleting attachment 18284827-2c1f-4ad8-b278-dd1e6745b3d2. {{(pid=86148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:39:51 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fa44e9c2-f2cf-441c-b9b4-82b14d30eb53 tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5cce599-b566-49ec-963a-7829ff3f0e81" returned: 0 in 0.791s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:51 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fa44e9c2-f2cf-441c-b9b4-82b14d30eb53 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-quobyte-f5cce599-b566-49ec-963a-7829ff3f0e81" released by "delete_volume" :: held 1.771s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:51 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-fa44e9c2-f2cf-441c-b9b4-82b14d30eb53 tempest-CreateVolumesFromSnapshotTest-781471547 None] Created reservations ['55e8a320-808c-4f8f-b1e8-2a2bdf487c49', '39c9c151-07c6-4169-8142-7f90378fe214', '59a0bbc4-9e1e-4e0c-85be-d8e70f4ac5d7', 'a2ac9214-b4d8-4724-96c5-ed26933fa80d'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fa44e9c2-f2cf-441c-b9b4-82b14d30eb53 tempest-CreateVolumesFromSnapshotTest-781471547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fa44e9c2-f2cf-441c-b9b4-82b14d30eb53 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fa44e9c2-f2cf-441c-b9b4-82b14d30eb53 tempest-CreateVolumesFromSnapshotTest-781471547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fa44e9c2-f2cf-441c-b9b4-82b14d30eb53 tempest-CreateVolumesFromSnapshotTest-781471547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fa44e9c2-f2cf-441c-b9b4-82b14d30eb53 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fa44e9c2-f2cf-441c-b9b4-82b14d30eb53 tempest-CreateVolumesFromSnapshotTest-781471547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:51 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:39:51 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:52 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fa44e9c2-f2cf-441c-b9b4-82b14d30eb53 tempest-CreateVolumesFromSnapshotTest-781471547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.821s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:52 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-fa44e9c2-f2cf-441c-b9b4-82b14d30eb53 tempest-CreateVolumesFromSnapshotTest-781471547 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:52 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-fa44e9c2-f2cf-441c-b9b4-82b14d30eb53 tempest-CreateVolumesFromSnapshotTest-781471547 None] Deleted volume successfully. Jul 06 15:39:52 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fa44e9c2-f2cf-441c-b9b4-82b14d30eb53 tempest-CreateVolumesFromSnapshotTest-781471547 None] Lock "cinder-f5cce599-b566-49ec-963a-7829ff3f0e81-delete_volume" released by "delete_volume" :: held 2.946s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:52 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:39:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Flow 'volume_create_manager' (d7f1719c-b12e-4c76-9342-944e029f1a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b76f11b1-ecdf-4ff6-a3fd-57f348533c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b76f11b1-ecdf-4ff6-a3fd-57f348533c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-110870812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=902a9eb8-71c4-42fd-81ca-417d18e7342c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='875633ef19f0490ca18a3e293d364d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:52Z,use_quota=True,user_id='17bb829bbe174c0eaf93ad7138ecf168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ed4d3e-b11c-4982-a16a-23ed81bec322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ed4d3e-b11c-4982-a16a-23ed81bec322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc9e208-5c68-40d9-befd-8b1d1a7409c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:52 devstack cinder-volume[86148]: DEBUG cinder.image.glance [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Creating Keystone auth plugin from conf {{(pid=86148) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 15:39:52 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8c9634d9-6991-4f4b-9e6e-977d59fdf096 tempest-TestInstancesWithCinderVolumes-396084605 None] Acquiring lock "cinder-aae3b6be-4884-4c0a-bdb4-c30159797430-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:52 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8c9634d9-6991-4f4b-9e6e-977d59fdf096 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "cinder-aae3b6be-4884-4c0a-bdb4-c30159797430-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:52 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8c9634d9-6991-4f4b-9e6e-977d59fdf096 tempest-TestInstancesWithCinderVolumes-396084605 None] Acquiring lock "cinder-quobyte-aae3b6be-4884-4c0a-bdb4-c30159797430" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:52 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8c9634d9-6991-4f4b-9e6e-977d59fdf096 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "cinder-quobyte-aae3b6be-4884-4c0a-bdb4-c30159797430" acquired by "delete_volume" :: waited 0.040s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:52 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bc24cd-0f69-4c74-ac35-14dc00e2f5ea]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8c9634d9-6991-4f4b-9e6e-977d59fdf096 tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-aae3b6be-4884-4c0a-bdb4-c30159797430 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:53 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-aae3b6be-4884-4c0a-bdb4-c30159797430 Jul 06 15:39:53 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc9e208-5c68-40d9-befd-8b1d1a7409c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '902a9eb8-71c4-42fd-81ca-417d18e7342c', 'volume_name': 'volume-902a9eb8-71c4-42fd-81ca-417d18e7342c', 'volume_size': 1, 'image_id': 'aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2cea8b96599e40e1978f302796eb3239', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'created_at': datetime.datetime(2026, 7, 6, 13, 18, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 18, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6e7027-78f6-4142-91c9-0cab6ca4c2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6e7027-78f6-4142-91c9-0cab6ca4c2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f4cce3-8a4a-4b94-96a2-ec1c464a0475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:53 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Volume 902a9eb8-71c4-42fd-81ca-417d18e7342c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-902a9eb8-71c4-42fd-81ca-417d18e7342c', 'volume_size': 1, 'image_id': 'aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2cea8b96599e40e1978f302796eb3239', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'created_at': datetime.datetime(2026, 7, 6, 13, 18, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 18, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 15:39:53 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Trying to clone 902a9eb8-71c4-42fd-81ca-417d18e7342c from image aab1d6f3-bc8c-4137-9f0e-54346f68c452 at location (None, [{'url': 'file:///opt/stack/data/glance/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'metadata': {}}]). {{(pid=86148) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 15:39:53 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_wj1m1ph9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86148) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 15:39:53 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Image download 20.69 MB at 20.69 MB/s Jul 06 15:39:54 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[c241ea35-3c6c-4320-9d46-8ab28e1428d0]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_wj1m1ph9devstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:54 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8c9634d9-6991-4f4b-9e6e-977d59fdf096 tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-aae3b6be-4884-4c0a-bdb4-c30159797430" returned: 0 in 1.384s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8c9634d9-6991-4f4b-9e6e-977d59fdf096 tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-aae3b6be-4884-4c0a-bdb4-c30159797430 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:54 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_wj1m1ph9devstack@QuobyteHD Jul 06 15:39:54 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:54 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-aae3b6be-4884-4c0a-bdb4-c30159797430 Jul 06 15:39:54 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:55 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8c9634d9-6991-4f4b-9e6e-977d59fdf096 tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-aae3b6be-4884-4c0a-bdb4-c30159797430" returned: 0 in 1.195s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:55 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_wj1m1ph9devstack@QuobyteHD" returned: 0 in 1.420s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:55 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Temporary image aab1d6f3-bc8c-4137-9f0e-54346f68c452 is fetched for user 17bb829bbe174c0eaf93ad7138ecf168. {{(pid=86148) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 15:39:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8c9634d9-6991-4f4b-9e6e-977d59fdf096 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "cinder-quobyte-aae3b6be-4884-4c0a-bdb4-c30159797430" released by "delete_volume" :: held 2.657s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:55 devstack cinder-volume[86148]: WARNING cinder.quota [None req-8c9634d9-6991-4f4b-9e6e-977d59fdf096 tempest-TestInstancesWithCinderVolumes-396084605 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-484536682-819893948 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-484536682-819893948, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:39:55 devstack cinder-volume[86148]: WARNING cinder.quota [None req-8c9634d9-6991-4f4b-9e6e-977d59fdf096 tempest-TestInstancesWithCinderVolumes-396084605 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-484536682-819893948 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-484536682-819893948, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:39:55 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-8c9634d9-6991-4f4b-9e6e-977d59fdf096 tempest-TestInstancesWithCinderVolumes-396084605 None] Created reservations ['e83578ee-0ca6-4f56-bb0e-5b842e4ac73f', 'e26c3f45-c208-44df-b930-23594b7ff721', '74c23efe-98be-4567-bac1-9c93dc0d839c', '281988ad-67b5-4553-9651-6b2cdfdc6dc3'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:55 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb26fb24-eb76-45e2-8d30-3b1017265f8d]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_wj1m1ph9devstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8c9634d9-6991-4f4b-9e6e-977d59fdf096 tempest-TestInstancesWithCinderVolumes-396084605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8c9634d9-6991-4f4b-9e6e-977d59fdf096 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:55 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-8c9634d9-6991-4f4b-9e6e-977d59fdf096 tempest-TestInstancesWithCinderVolumes-396084605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:55 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-8c9634d9-6991-4f4b-9e6e-977d59fdf096 tempest-TestInstancesWithCinderVolumes-396084605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8c9634d9-6991-4f4b-9e6e-977d59fdf096 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8c9634d9-6991-4f4b-9e6e-977d59fdf096 tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:55 devstack sudo[101248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:39:55 devstack sudo[101248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:55 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_wj1m1ph9devstack@QuobyteHD Jul 06 15:39:55 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:56 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_wj1m1ph9devstack@QuobyteHD" returned: 0 in 1.139s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-110870812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=902a9eb8-71c4-42fd-81ca-417d18e7342c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='875633ef19f0490ca18a3e293d364d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:52Z,use_quota=True,user_id='17bb829bbe174c0eaf93ad7138ecf168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:39:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Creating volume 902a9eb8-71c4-42fd-81ca-417d18e7342c {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:39:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:56 devstack sudo[101248]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:39:56 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:39:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8c9634d9-6991-4f4b-9e6e-977d59fdf096 tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.986s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:56 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-8c9634d9-6991-4f4b-9e6e-977d59fdf096 tempest-TestInstancesWithCinderVolumes-396084605 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:56 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-8c9634d9-6991-4f4b-9e6e-977d59fdf096 tempest-TestInstancesWithCinderVolumes-396084605 None] Deleted volume successfully. Jul 06 15:39:56 devstack sudo[101257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c 1073741824 Jul 06 15:39:56 devstack sudo[101257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8c9634d9-6991-4f4b-9e6e-977d59fdf096 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "cinder-aae3b6be-4884-4c0a-bdb4-c30159797430-delete_volume" released by "delete_volume" :: held 4.158s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:57 devstack sudo[101257]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c 1073741824" returned: 0 in 0.934s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:57 devstack sudo[101263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c Jul 06 15:39:57 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:58 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c" returned: 0 in 0.696s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:58 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:39:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:58 devstack cinder-volume[86148]: DEBUG cinder.volume.volume_utils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Attempting download of aab1d6f3-bc8c-4137-9f0e-54346f68c452 ((None, [{'url': 'file:///opt/stack/data/glance/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'metadata': {}}])) to volume 902a9eb8-71c4-42fd-81ca-417d18e7342c. {{(pid=86148) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 15:39:58 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da1f26a-c93c-4031-83ab-df9c6047eff9]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aab1d6f3-bc8c-4137-9f0e-54346f68c452_4bwl7dn2 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:58 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aab1d6f3-bc8c-4137-9f0e-54346f68c452_4bwl7dn2 Jul 06 15:39:58 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:59 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:39:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Flow 'volume_create_manager' (97f50362-3880-4ac5-a207-b08dac1e37a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e64d147e-f9f8-47a8-bbb0-7e05aed1a229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e64d147e-f9f8-47a8-bbb0-7e05aed1a229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=031a29de-7642-4dff-9f9b-6dd88869bdc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e37e4fab314b42824fde35f9975b08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:59Z,use_quota=True,user_id='15dc7233d2674c18a29459149afff278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:59 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c3d2b28-9e77-437e-8225-ed25c0994a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c3d2b28-9e77-437e-8225-ed25c0994a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af8d9f2-e179-431b-9edc-df0305333a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:59 devstack cinder-volume[86148]: DEBUG cinder.image.glance [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Creating Keystone auth plugin from conf {{(pid=86148) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 15:39:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aab1d6f3-bc8c-4137-9f0e-54346f68c452_4bwl7dn2" returned: 0 in 0.940s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aab1d6f3-bc8c-4137-9f0e-54346f68c452_4bwl7dn2 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:59 devstack sudo[101294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aab1d6f3-bc8c-4137-9f0e-54346f68c452_4bwl7dn2 Jul 06 15:39:59 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af8d9f2-e179-431b-9edc-df0305333a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '031a29de-7642-4dff-9f9b-6dd88869bdc8', 'volume_name': 'volume-031a29de-7642-4dff-9f9b-6dd88869bdc8', 'volume_size': 1, 'image_id': '00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '236cdbb79adad0504b9de255f8634689', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '61e37e4fab314b42824fde35f9975b08', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a9109af4872f7902bd6b9f712cdd8850b6c664003017fedabb152212d62196276cb521eba75309c6bd8a6d7c5177f6722434f73adcf36f966b0a0046ae6f6605', 'id': '00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d', 'created_at': datetime.datetime(2026, 7, 6, 13, 39, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 39, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d/file', 'properties': {}}, 'image_service': }' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9610d97-a5d5-4892-9265-2f31216e5ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9610d97-a5d5-4892-9265-2f31216e5ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (109c0fef-7a5d-4e98-8751-abfb998196f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:59 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Volume 031a29de-7642-4dff-9f9b-6dd88869bdc8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-031a29de-7642-4dff-9f9b-6dd88869bdc8', 'volume_size': 1, 'image_id': '00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '236cdbb79adad0504b9de255f8634689', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '61e37e4fab314b42824fde35f9975b08', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a9109af4872f7902bd6b9f712cdd8850b6c664003017fedabb152212d62196276cb521eba75309c6bd8a6d7c5177f6722434f73adcf36f966b0a0046ae6f6605', 'id': '00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d', 'created_at': datetime.datetime(2026, 7, 6, 13, 39, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 39, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d/file', 'properties': {}}, 'image_service': } Jul 06 15:39:59 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Trying to clone 031a29de-7642-4dff-9f9b-6dd88869bdc8 from image 00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d at location (None, [{'url': 'file:///opt/stack/data/glance/images/00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d', 'metadata': {}}]). {{(pid=86148) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 15:39:59 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_3o98gyasdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86148) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 15:39:59 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Image download 0.00 MB at 0.00 MB/s Jul 06 15:39:59 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd897ff-cc33-4a23-bebb-3add606a982b]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_3o98gyasdevstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:59 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_3o98gyasdevstack@QuobyteHD Jul 06 15:39:59 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:00 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aab1d6f3-bc8c-4137-9f0e-54346f68c452_4bwl7dn2" returned: 1 in 0.862s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aab1d6f3-bc8c-4137-9f0e-54346f68c452_4bwl7dn2' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:40:00 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[26194e7a-5656-48f0-8f7c-94bd6f52fcfc]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_wj1m1ph9devstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:00 devstack sudo[101301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_wj1m1ph9devstack@QuobyteHD Jul 06 15:40:00 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:00 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_3o98gyasdevstack@QuobyteHD" returned: 0 in 0.765s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_3o98gyasdevstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:00 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_3o98gyasdevstack@QuobyteHD Jul 06 15:40:00 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:01 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_wj1m1ph9devstack@QuobyteHD" returned: 0 in 0.738s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:01 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] aab1d6f3-bc8c-4137-9f0e-54346f68c452 was qcow2, converting to raw {{(pid=86148) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 15:40:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_wj1m1ph9devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:01 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_wj1m1ph9devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c Jul 06 15:40:01 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:01 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-782c0e03-072c-49e9-bee3-055ef586d2e6 req-5b424346-a213-49d2-b4bb-86600cdd3931 tempest-TestInstancesWithCinderVolumes-396084605 None] Terminate volume connection completed successfully. Jul 06 15:40:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-782c0e03-072c-49e9-bee3-055ef586d2e6 req-5b424346-a213-49d2-b4bb-86600cdd3931 tempest-TestInstancesWithCinderVolumes-396084605 None] Deleting attachment 0b2751f0-a0fb-4967-bd7b-17a6c35d9381. {{(pid=86148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:40:01 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_3o98gyasdevstack@QuobyteHD" returned: 1 in 0.727s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_3o98gyasdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:40:01 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Temporary image 00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d is fetched for user 15dc7233d2674c18a29459149afff278. {{(pid=86148) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 15:40:01 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[e922d640-e345-4ed2-895f-5008f574995e]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_3o98gyasdevstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:01 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_3o98gyasdevstack@QuobyteHD Jul 06 15:40:01 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:02 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_3o98gyasdevstack@QuobyteHD" returned: 0 in 0.823s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_3o98gyasdevstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:02 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_3o98gyasdevstack@QuobyteHD Jul 06 15:40:02 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:03 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_wj1m1ph9devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c" returned: 0 in 1.992s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:03 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:03 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_wj1m1ph9devstack@QuobyteHD, size 112.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c {{(pid=86148) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:40:03 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Converted 112.00 MB image at 56.19 MB/s Jul 06 15:40:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_3o98gyasdevstack@QuobyteHD" returned: 1 in 0.824s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_3o98gyasdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:40:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:03 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=031a29de-7642-4dff-9f9b-6dd88869bdc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e37e4fab314b42824fde35f9975b08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:59Z,use_quota=True,user_id='15dc7233d2674c18a29459149afff278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:40:03 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Creating volume 031a29de-7642-4dff-9f9b-6dd88869bdc8 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:40:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:03 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:03 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:03 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:40:03 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:40:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:03 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c 1G Jul 06 15:40:03 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:03 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8 1073741824 Jul 06 15:40:03 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:03 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c 1G" returned: 0 in 0.756s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:03 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3db92e-406c-4581-a953-fd68e72ec28a]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:03 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8 1073741824" returned: 0 in 0.851s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:03 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c Jul 06 15:40:03 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:03 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8 Jul 06 15:40:03 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:04 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fd9693cd-bdd6-41b7-8c91-8e80fb62c1d1 tempest-TestInstancesWithCinderVolumes-396084605 None] Acquiring lock "cinder-cf10def9-ad3c-4921-abf3-565e88dc5f9d-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:04 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fd9693cd-bdd6-41b7-8c91-8e80fb62c1d1 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "cinder-cf10def9-ad3c-4921-abf3-565e88dc5f9d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:04 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fd9693cd-bdd6-41b7-8c91-8e80fb62c1d1 tempest-TestInstancesWithCinderVolumes-396084605 None] Acquiring lock "cinder-quobyte-cf10def9-ad3c-4921-abf3-565e88dc5f9d" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:04 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fd9693cd-bdd6-41b7-8c91-8e80fb62c1d1 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "cinder-quobyte-cf10def9-ad3c-4921-abf3-565e88dc5f9d" acquired by "delete_volume" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:04 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6a0670-751e-477f-bbaf-2c48e58f33b3]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fd9693cd-bdd6-41b7-8c91-8e80fb62c1d1 tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:04 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d Jul 06 15:40:04 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:04 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8" returned: 0 in 0.686s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:04 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:40:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:04 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:04 devstack cinder-volume[86148]: DEBUG cinder.volume.volume_utils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Attempting download of 00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d ((None, [{'url': 'file:///opt/stack/data/glance/images/00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d', 'metadata': {}}])) to volume 031a29de-7642-4dff-9f9b-6dd88869bdc8. {{(pid=86148) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 15:40:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c" returned: 0 in 0.836s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:04 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f81135b-a3f9-458b-96ae-f3b49bb33b07]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_0iwgosef {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:04 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c Jul 06 15:40:04 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:04 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_0iwgosef Jul 06 15:40:04 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:05 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fd9693cd-bdd6-41b7-8c91-8e80fb62c1d1 tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d" returned: 0 in 0.765s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fd9693cd-bdd6-41b7-8c91-8e80fb62c1d1 tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:05 devstack sudo[101357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d Jul 06 15:40:05 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:05 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c" returned: 1 in 0.747s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:40:05 devstack cinder-volume[86148]: DEBUG cinder.volume.volume_utils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Downloaded image aab1d6f3-bc8c-4137-9f0e-54346f68c452 ((None, [{'url': 'file:///opt/stack/data/glance/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'metadata': {}}])) to volume 902a9eb8-71c4-42fd-81ca-417d18e7342c successfully. {{(pid=86148) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 15:40:05 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Temporary image aab1d6f3-bc8c-4137-9f0e-54346f68c452 for user 17bb829bbe174c0eaf93ad7138ecf168 is deleted. {{(pid=86148) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 15:40:05 devstack cinder-volume[86148]: DEBUG cinder.volume.volume_utils [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Marking volume 902a9eb8-71c4-42fd-81ca-417d18e7342c as bootable. {{(pid=86148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 15:40:05 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Copying metadata from image aab1d6f3-bc8c-4137-9f0e-54346f68c452 to 902a9eb8-71c4-42fd-81ca-417d18e7342c. {{(pid=86148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 15:40:05 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Creating volume glance metadata for volume 902a9eb8-71c4-42fd-81ca-417d18e7342c backed by image aab1d6f3-bc8c-4137-9f0e-54346f68c452 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86148) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 15:40:05 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_0iwgosef" returned: 0 in 0.755s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_0iwgosef {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:05 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_0iwgosef Jul 06 15:40:05 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f4cce3-8a4a-4b94-96a2-ec1c464a0475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-902a9eb8-71c4-42fd-81ca-417d18e7342c', 'volume_size': 1, 'image_id': 'aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2cea8b96599e40e1978f302796eb3239', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'created_at': datetime.datetime(2026, 7, 6, 13, 18, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 18, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dd517a8-4d6c-46a6-b81e-9cc3ec9a0860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:05 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Volume volume-902a9eb8-71c4-42fd-81ca-417d18e7342c (902a9eb8-71c4-42fd-81ca-417d18e7342c): created successfully Jul 06 15:40:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dd517a8-4d6c-46a6-b81e-9cc3ec9a0860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Flow 'volume_create_manager' (d7f1719c-b12e-4c76-9342-944e029f1a64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:40:05 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-1aacb32f-abfb-4b37-9d7c-2ff9b9b76d8c tempest-VolumesExtendTest-2124769706 None] Created volume successfully. Jul 06 15:40:06 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fd9693cd-bdd6-41b7-8c91-8e80fb62c1d1 tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d" returned: 1 in 0.731s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fd9693cd-bdd6-41b7-8c91-8e80fb62c1d1 tempest-TestInstancesWithCinderVolumes-396084605 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:40:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fd9693cd-bdd6-41b7-8c91-8e80fb62c1d1 tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:06 devstack sudo[101369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d Jul 06 15:40:06 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:06 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_0iwgosef" returned: 1 in 0.714s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_0iwgosef' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:40:06 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9edf395-7855-415e-b673-126e21209721]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_3o98gyasdevstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:06 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_3o98gyasdevstack@QuobyteHD Jul 06 15:40:06 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:06 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fd9693cd-bdd6-41b7-8c91-8e80fb62c1d1 tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cf10def9-ad3c-4921-abf3-565e88dc5f9d" returned: 0 in 0.634s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:06 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fd9693cd-bdd6-41b7-8c91-8e80fb62c1d1 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "cinder-quobyte-cf10def9-ad3c-4921-abf3-565e88dc5f9d" released by "delete_volume" :: held 2.234s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:06 devstack cinder-volume[86148]: WARNING cinder.quota [None req-fd9693cd-bdd6-41b7-8c91-8e80fb62c1d1 tempest-TestInstancesWithCinderVolumes-396084605 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2006360618-996612780 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2006360618-996612780, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:40:06 devstack cinder-volume[86148]: WARNING cinder.quota [None req-fd9693cd-bdd6-41b7-8c91-8e80fb62c1d1 tempest-TestInstancesWithCinderVolumes-396084605 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2006360618-996612780 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2006360618-996612780, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:40:06 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-fd9693cd-bdd6-41b7-8c91-8e80fb62c1d1 tempest-TestInstancesWithCinderVolumes-396084605 None] Created reservations ['c3658f6d-0b7c-400d-86de-edc3e74e7128', '076b276e-1c57-401f-81ac-7386ab2f3eee', 'cfbbcd37-1672-42f1-93d7-b7c12f8f716d', '77a9886b-55d4-4bf2-a1c1-5cb60aea92c4'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:40:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e372e69f-b311-4baf-9424-38a8058ec646 tempest-VolumesExtendTest-2124769706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e372e69f-b311-4baf-9424-38a8058ec646 tempest-VolumesExtendTest-2124769706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fd9693cd-bdd6-41b7-8c91-8e80fb62c1d1 tempest-TestInstancesWithCinderVolumes-396084605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fd9693cd-bdd6-41b7-8c91-8e80fb62c1d1 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:06 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fd9693cd-bdd6-41b7-8c91-8e80fb62c1d1 tempest-TestInstancesWithCinderVolumes-396084605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:06 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fd9693cd-bdd6-41b7-8c91-8e80fb62c1d1 tempest-TestInstancesWithCinderVolumes-396084605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fd9693cd-bdd6-41b7-8c91-8e80fb62c1d1 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fd9693cd-bdd6-41b7-8c91-8e80fb62c1d1 tempest-TestInstancesWithCinderVolumes-396084605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:06 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d8c143-0d1b-48ba-aec6-07ef45a0eba7]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e372e69f-b311-4baf-9424-38a8058ec646 tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:06 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:40:06 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:06 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_3o98gyasdevstack@QuobyteHD" returned: 0 in 0.750s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_3o98gyasdevstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:06 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c Jul 06 15:40:06 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:07 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_3o98gyasdevstack@QuobyteHD Jul 06 15:40:07 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:07 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fd9693cd-bdd6-41b7-8c91-8e80fb62c1d1 tempest-TestInstancesWithCinderVolumes-396084605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.652s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:07 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-fd9693cd-bdd6-41b7-8c91-8e80fb62c1d1 tempest-TestInstancesWithCinderVolumes-396084605 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:40:07 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-fd9693cd-bdd6-41b7-8c91-8e80fb62c1d1 tempest-TestInstancesWithCinderVolumes-396084605 None] Deleted volume successfully. Jul 06 15:40:07 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fd9693cd-bdd6-41b7-8c91-8e80fb62c1d1 tempest-TestInstancesWithCinderVolumes-396084605 None] Lock "cinder-cf10def9-ad3c-4921-abf3-565e88dc5f9d-delete_volume" released by "delete_volume" :: held 3.178s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:07 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e372e69f-b311-4baf-9424-38a8058ec646 tempest-VolumesExtendTest-2124769706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c" returned: 0 in 0.776s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e372e69f-b311-4baf-9424-38a8058ec646 tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:07 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_3o98gyasdevstack@QuobyteHD" returned: 1 in 0.738s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_3o98gyasdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:40:07 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] 00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d was raw, converting to raw {{(pid=86148) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 15:40:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_3o98gyasdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:07 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_3o98gyasdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8 Jul 06 15:40:07 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:07 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c Jul 06 15:40:07 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:08 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e372e69f-b311-4baf-9424-38a8058ec646 tempest-VolumesExtendTest-2124769706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c" returned: 1 in 0.785s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e372e69f-b311-4baf-9424-38a8058ec646 tempest-VolumesExtendTest-2124769706 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:40:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e372e69f-b311-4baf-9424-38a8058ec646 tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c 2G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:08 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_3o98gyasdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8" returned: 0 in 0.767s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:08 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d_3o98gyasdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8 {{(pid=86148) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:40:08 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 15:40:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e372e69f-b311-4baf-9424-38a8058ec646 tempest-VolumesExtendTest-2124769706 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c 2G" returned: 0 in 0.062s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e372e69f-b311-4baf-9424-38a8058ec646 tempest-VolumesExtendTest-2124769706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.680s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:08 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8 1G Jul 06 15:40:08 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:08 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-e372e69f-b311-4baf-9424-38a8058ec646 tempest-VolumesExtendTest-2124769706 None] Extend volume completed successfully. Jul 06 15:40:09 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8 1G" returned: 0 in 0.720s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:09 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-be3dda68-01ec-4f11-8cb7-ab5d181c1074 tempest-VolumesExtendTest-2124769706 None] Acquiring lock "cinder-902a9eb8-71c4-42fd-81ca-417d18e7342c-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:09 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-be3dda68-01ec-4f11-8cb7-ab5d181c1074 tempest-VolumesExtendTest-2124769706 None] Lock "cinder-902a9eb8-71c4-42fd-81ca-417d18e7342c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:09 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[542bfc56-9ca0-4ae6-beff-eae64e9d5ede]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:09 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-be3dda68-01ec-4f11-8cb7-ab5d181c1074 tempest-VolumesExtendTest-2124769706 None] Acquiring lock "cinder-quobyte-902a9eb8-71c4-42fd-81ca-417d18e7342c" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:09 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-be3dda68-01ec-4f11-8cb7-ab5d181c1074 tempest-VolumesExtendTest-2124769706 None] Lock "cinder-quobyte-902a9eb8-71c4-42fd-81ca-417d18e7342c" acquired by "delete_volume" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:09 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[582403bb-dc15-403c-aca4-d1e869467bbe]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-be3dda68-01ec-4f11-8cb7-ab5d181c1074 tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:09 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8 Jul 06 15:40:09 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:09 devstack sudo[101411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c Jul 06 15:40:09 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:10 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8" returned: 0 in 0.819s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:10 devstack sudo[101419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8 Jul 06 15:40:10 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:10 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-be3dda68-01ec-4f11-8cb7-ab5d181c1074 tempest-VolumesExtendTest-2124769706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c" returned: 0 in 0.873s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-be3dda68-01ec-4f11-8cb7-ab5d181c1074 tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:10 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c Jul 06 15:40:10 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:10 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8" returned: 1 in 0.803s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:40:10 devstack cinder-volume[86148]: DEBUG cinder.volume.volume_utils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Downloaded image 00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d ((None, [{'url': 'file:///opt/stack/data/glance/images/00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d', 'metadata': {}}])) to volume 031a29de-7642-4dff-9f9b-6dd88869bdc8 successfully. {{(pid=86148) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 15:40:10 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Temporary image 00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d for user 15dc7233d2674c18a29459149afff278 is deleted. {{(pid=86148) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 15:40:10 devstack cinder-volume[86148]: DEBUG cinder.volume.volume_utils [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Marking volume 031a29de-7642-4dff-9f9b-6dd88869bdc8 as bootable. {{(pid=86148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 15:40:10 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Copying metadata from image 00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d to 031a29de-7642-4dff-9f9b-6dd88869bdc8. {{(pid=86148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 15:40:10 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Creating volume glance metadata for volume 031a29de-7642-4dff-9f9b-6dd88869bdc8 backed by image 00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d with: {'image_id': '00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '236cdbb79adad0504b9de255f8634689', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86148) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 15:40:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (109c0fef-7a5d-4e98-8751-abfb998196f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-031a29de-7642-4dff-9f9b-6dd88869bdc8', 'volume_size': 1, 'image_id': '00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '236cdbb79adad0504b9de255f8634689', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '61e37e4fab314b42824fde35f9975b08', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a9109af4872f7902bd6b9f712cdd8850b6c664003017fedabb152212d62196276cb521eba75309c6bd8a6d7c5177f6722434f73adcf36f966b0a0046ae6f6605', 'id': '00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d', 'created_at': datetime.datetime(2026, 7, 6, 13, 39, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 39, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00c791d0-6d22-4aed-b7ef-5fdb80dc6e8d/file', 'properties': {}}, 'image_service': }' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6479427a-12ac-4f76-8532-f0cef412bae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:11 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-be3dda68-01ec-4f11-8cb7-ab5d181c1074 tempest-VolumesExtendTest-2124769706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c" returned: 1 in 0.802s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-be3dda68-01ec-4f11-8cb7-ab5d181c1074 tempest-VolumesExtendTest-2124769706 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:40:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-be3dda68-01ec-4f11-8cb7-ab5d181c1074 tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:11 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Volume volume-031a29de-7642-4dff-9f9b-6dd88869bdc8 (031a29de-7642-4dff-9f9b-6dd88869bdc8): created successfully Jul 06 15:40:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6479427a-12ac-4f76-8532-f0cef412bae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Flow 'volume_create_manager' (97f50362-3880-4ac5-a207-b08dac1e37a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:40:11 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c Jul 06 15:40:11 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:11 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-71360cb0-ce5f-4743-9d44-4b0614a3d671 tempest-VolumeImageDependencyTests-2111081930 None] Created volume successfully. Jul 06 15:40:11 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-be3dda68-01ec-4f11-8cb7-ab5d181c1074 tempest-VolumesExtendTest-2124769706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-902a9eb8-71c4-42fd-81ca-417d18e7342c" returned: 0 in 0.707s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:11 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-be3dda68-01ec-4f11-8cb7-ab5d181c1074 tempest-VolumesExtendTest-2124769706 None] Lock "cinder-quobyte-902a9eb8-71c4-42fd-81ca-417d18e7342c" released by "delete_volume" :: held 2.445s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:11 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-be3dda68-01ec-4f11-8cb7-ab5d181c1074 tempest-VolumesExtendTest-2124769706 None] Created reservations ['e18a25f7-c8e6-47e3-9043-5c157d392d4e', 'c9178d03-9611-4f3e-8da6-a549ceec2b60', 'd2040e08-f6a0-430b-a2fc-e61d7e578660', '50664032-7483-4614-ad3d-c10112a7a72f'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:40:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-be3dda68-01ec-4f11-8cb7-ab5d181c1074 tempest-VolumesExtendTest-2124769706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-be3dda68-01ec-4f11-8cb7-ab5d181c1074 tempest-VolumesExtendTest-2124769706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-be3dda68-01ec-4f11-8cb7-ab5d181c1074 tempest-VolumesExtendTest-2124769706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-be3dda68-01ec-4f11-8cb7-ab5d181c1074 tempest-VolumesExtendTest-2124769706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-be3dda68-01ec-4f11-8cb7-ab5d181c1074 tempest-VolumesExtendTest-2124769706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-be3dda68-01ec-4f11-8cb7-ab5d181c1074 tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:11 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:40:11 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:12 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8968c7b4-16fb-4577-85f6-a79b9a576ea2 tempest-VolumeImageDependencyTests-2111081930 None] Acquiring lock "cinder-031a29de-7642-4dff-9f9b-6dd88869bdc8-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:12 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8968c7b4-16fb-4577-85f6-a79b9a576ea2 tempest-VolumeImageDependencyTests-2111081930 None] Lock "cinder-031a29de-7642-4dff-9f9b-6dd88869bdc8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:12 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8968c7b4-16fb-4577-85f6-a79b9a576ea2 tempest-VolumeImageDependencyTests-2111081930 None] Acquiring lock "cinder-quobyte-031a29de-7642-4dff-9f9b-6dd88869bdc8" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:12 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8968c7b4-16fb-4577-85f6-a79b9a576ea2 tempest-VolumeImageDependencyTests-2111081930 None] Lock "cinder-quobyte-031a29de-7642-4dff-9f9b-6dd88869bdc8" acquired by "delete_volume" :: waited 0.015s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:12 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e08cc86-2bc1-4d5f-a6cd-01789f3739d7]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8968c7b4-16fb-4577-85f6-a79b9a576ea2 tempest-VolumeImageDependencyTests-2111081930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:12 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8 Jul 06 15:40:12 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:12 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-be3dda68-01ec-4f11-8cb7-ab5d181c1074 tempest-VolumesExtendTest-2124769706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.737s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:12 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-be3dda68-01ec-4f11-8cb7-ab5d181c1074 tempest-VolumesExtendTest-2124769706 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:40:12 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-be3dda68-01ec-4f11-8cb7-ab5d181c1074 tempest-VolumesExtendTest-2124769706 None] Deleted volume successfully. Jul 06 15:40:12 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-be3dda68-01ec-4f11-8cb7-ab5d181c1074 tempest-VolumesExtendTest-2124769706 None] Lock "cinder-902a9eb8-71c4-42fd-81ca-417d18e7342c-delete_volume" released by "delete_volume" :: held 3.449s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:13 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:40:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Flow 'volume_create_manager' (396ae4f5-38fb-4c5c-a18d-28d44f9ade4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:40:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (472998f2-2eeb-4cf9-85dd-58f2cacef88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (472998f2-2eeb-4cf9-85dd-58f2cacef88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-396118226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b5f0ace-ab71-4b66-8d41-e9126cc8bc86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='875633ef19f0490ca18a3e293d364d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:40:13Z,use_quota=True,user_id='17bb829bbe174c0eaf93ad7138ecf168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5bbee3d-e5d7-42df-861a-8c32da3a0854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5bbee3d-e5d7-42df-861a-8c32da3a0854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29177fa-dd91-4087-a475-87e71cfeaf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29177fa-dd91-4087-a475-87e71cfeaf37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b5f0ace-ab71-4b66-8d41-e9126cc8bc86', 'volume_name': 'volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce787cac-782a-4431-aa56-1fb8255a0d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce787cac-782a-4431-aa56-1fb8255a0d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d945b73-f505-404c-9c44-404df94268fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:13 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Volume 4b5f0ace-ab71-4b66-8d41-e9126cc8bc86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86', 'volume_size': 1} Jul 06 15:40:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:13 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-396118226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b5f0ace-ab71-4b66-8d41-e9126cc8bc86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='875633ef19f0490ca18a3e293d364d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:40:13Z,use_quota=True,user_id='17bb829bbe174c0eaf93ad7138ecf168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:40:13 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Creating volume 4b5f0ace-ab71-4b66-8d41-e9126cc8bc86 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:40:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:13 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:13 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:13 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:40:13 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:40:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:13 devstack sudo[101442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86 1073741824 Jul 06 15:40:13 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:13 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8968c7b4-16fb-4577-85f6-a79b9a576ea2 tempest-VolumeImageDependencyTests-2111081930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8" returned: 0 in 0.915s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8968c7b4-16fb-4577-85f6-a79b9a576ea2 tempest-VolumeImageDependencyTests-2111081930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:13 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8 Jul 06 15:40:13 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:14 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8968c7b4-16fb-4577-85f6-a79b9a576ea2 tempest-VolumeImageDependencyTests-2111081930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8" returned: 1 in 0.795s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8968c7b4-16fb-4577-85f6-a79b9a576ea2 tempest-VolumeImageDependencyTests-2111081930 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:40:14 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8968c7b4-16fb-4577-85f6-a79b9a576ea2 tempest-VolumeImageDependencyTests-2111081930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86 1073741824" returned: 0 in 0.929s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:14 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8 Jul 06 15:40:14 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:14 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86 Jul 06 15:40:14 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:14 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8968c7b4-16fb-4577-85f6-a79b9a576ea2 tempest-VolumeImageDependencyTests-2111081930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-031a29de-7642-4dff-9f9b-6dd88869bdc8" returned: 0 in 0.720s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8968c7b4-16fb-4577-85f6-a79b9a576ea2 tempest-VolumeImageDependencyTests-2111081930 None] Lock "cinder-quobyte-031a29de-7642-4dff-9f9b-6dd88869bdc8" released by "delete_volume" :: held 2.503s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:14 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86" returned: 0 in 0.704s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:40:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d945b73-f505-404c-9c44-404df94268fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9216146-ba8d-404b-802a-341e7f2f624a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:14 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Volume volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86 (4b5f0ace-ab71-4b66-8d41-e9126cc8bc86): created successfully Jul 06 15:40:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9216146-ba8d-404b-802a-341e7f2f624a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Flow 'volume_create_manager' (396ae4f5-38fb-4c5c-a18d-28d44f9ade4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:40:14 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-39a0e254-d998-4956-85bc-4740af0e8e3b tempest-VolumesExtendTest-2124769706 None] Created volume successfully. Jul 06 15:40:14 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-8968c7b4-16fb-4577-85f6-a79b9a576ea2 tempest-VolumeImageDependencyTests-2111081930 None] Created reservations ['0e918baa-55bc-461a-a5e7-ee7ecec575b4', '61e338f7-8840-4af2-a4bd-2dac58389d2e', '7a6f32e7-7d49-4869-9b91-b46f4ba4b078', '6faa1be0-f4b5-4c0a-90ee-7acb1b8b0792'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:40:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8968c7b4-16fb-4577-85f6-a79b9a576ea2 tempest-VolumeImageDependencyTests-2111081930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8968c7b4-16fb-4577-85f6-a79b9a576ea2 tempest-VolumeImageDependencyTests-2111081930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-8968c7b4-16fb-4577-85f6-a79b9a576ea2 tempest-VolumeImageDependencyTests-2111081930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-8968c7b4-16fb-4577-85f6-a79b9a576ea2 tempest-VolumeImageDependencyTests-2111081930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8968c7b4-16fb-4577-85f6-a79b9a576ea2 tempest-VolumeImageDependencyTests-2111081930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8968c7b4-16fb-4577-85f6-a79b9a576ea2 tempest-VolumeImageDependencyTests-2111081930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:14 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:40:14 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fec0b5eb-0bbc-4b43-9bfb-c301584503ff tempest-VolumesExtendTest-2124769706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fec0b5eb-0bbc-4b43-9bfb-c301584503ff tempest-VolumesExtendTest-2124769706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:15 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-fec0b5eb-0bbc-4b43-9bfb-c301584503ff tempest-VolumesExtendTest-2124769706 None] Creating offline snapshot 28fe61ae-2a50-429a-a88e-e9cee9b73b60 of volume 4b5f0ace-ab71-4b66-8d41-e9126cc8bc86 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:40:15 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[3521845c-e03b-466f-9f35-556648ff6588]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fec0b5eb-0bbc-4b43-9bfb-c301584503ff tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:15 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86 Jul 06 15:40:15 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:15 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8968c7b4-16fb-4577-85f6-a79b9a576ea2 tempest-VolumeImageDependencyTests-2111081930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.746s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:15 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-8968c7b4-16fb-4577-85f6-a79b9a576ea2 tempest-VolumeImageDependencyTests-2111081930 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:40:15 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-8968c7b4-16fb-4577-85f6-a79b9a576ea2 tempest-VolumeImageDependencyTests-2111081930 None] Deleted volume successfully. Jul 06 15:40:15 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8968c7b4-16fb-4577-85f6-a79b9a576ea2 tempest-VolumeImageDependencyTests-2111081930 None] Lock "cinder-031a29de-7642-4dff-9f9b-6dd88869bdc8-delete_volume" released by "delete_volume" :: held 3.483s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:16 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fec0b5eb-0bbc-4b43-9bfb-c301584503ff tempest-VolumesExtendTest-2124769706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86" returned: 0 in 0.912s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fec0b5eb-0bbc-4b43-9bfb-c301584503ff tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.28fe61ae-2a50-429a-a88e-e9cee9b73b60 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:16 devstack sudo[101468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.28fe61ae-2a50-429a-a88e-e9cee9b73b60 1G Jul 06 15:40:16 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:17 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fec0b5eb-0bbc-4b43-9bfb-c301584503ff tempest-VolumesExtendTest-2124769706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.28fe61ae-2a50-429a-a88e-e9cee9b73b60 1G" returned: 0 in 0.893s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fec0b5eb-0bbc-4b43-9bfb-c301584503ff tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.28fe61ae-2a50-429a-a88e-e9cee9b73b60 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:17 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.28fe61ae-2a50-429a-a88e-e9cee9b73b60 Jul 06 15:40:17 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:18 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fec0b5eb-0bbc-4b43-9bfb-c301584503ff tempest-VolumesExtendTest-2124769706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.28fe61ae-2a50-429a-a88e-e9cee9b73b60" returned: 0 in 0.786s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:18 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-fec0b5eb-0bbc-4b43-9bfb-c301584503ff tempest-VolumesExtendTest-2124769706 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.28fe61ae-2a50-429a-a88e-e9cee9b73b60 is being set with open permissions: ugo+rw Jul 06 15:40:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fec0b5eb-0bbc-4b43-9bfb-c301584503ff tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.28fe61ae-2a50-429a-a88e-e9cee9b73b60 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:18 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.28fe61ae-2a50-429a-a88e-e9cee9b73b60 Jul 06 15:40:18 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:18 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fec0b5eb-0bbc-4b43-9bfb-c301584503ff tempest-VolumesExtendTest-2124769706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.28fe61ae-2a50-429a-a88e-e9cee9b73b60" returned: 0 in 0.680s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fec0b5eb-0bbc-4b43-9bfb-c301584503ff tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:18 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.info Jul 06 15:40:18 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:19 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fec0b5eb-0bbc-4b43-9bfb-c301584503ff tempest-VolumesExtendTest-2124769706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.info" returned: 0 in 0.660s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:19 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-fec0b5eb-0bbc-4b43-9bfb-c301584503ff tempest-VolumesExtendTest-2124769706 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.info is being set with open permissions: ugo+rw Jul 06 15:40:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fec0b5eb-0bbc-4b43-9bfb-c301584503ff tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:19 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.info Jul 06 15:40:19 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:19 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:40:19 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Flow 'volume_create_manager' (42910daf-7036-49ed-9509-6bcb55462369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:40:19 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9583bb6-4b24-4ce1-96d2-cb66d9b551d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:19 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9583bb6-4b24-4ce1-96d2-cb66d9b551d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a353d2b1-019b-489d-a611-20c5f90146e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bc068386a834fc1a90f9bb0c78dc873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:40:20Z,use_quota=True,user_id='50e47a6feab8400586bdf03e49c0702a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:19 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01847904-a1da-4092-8a6f-493fa0ed688b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:19 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01847904-a1da-4092-8a6f-493fa0ed688b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:19 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (522fbe8a-7a16-4af9-aa66-b62f9578d901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:19 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (522fbe8a-7a16-4af9-aa66-b62f9578d901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a353d2b1-019b-489d-a611-20c5f90146e5', 'volume_name': 'volume-a353d2b1-019b-489d-a611-20c5f90146e5', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:19 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8977e5c4-84df-4cf7-a089-43090e37975a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:19 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8977e5c4-84df-4cf7-a089-43090e37975a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:19 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81aec5c4-716d-4a59-9e7e-ad4bf12f5668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:19 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Volume a353d2b1-019b-489d-a611-20c5f90146e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a353d2b1-019b-489d-a611-20c5f90146e5', 'volume_size': 1} Jul 06 15:40:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:20 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fec0b5eb-0bbc-4b43-9bfb-c301584503ff tempest-VolumesExtendTest-2124769706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.info" returned: 0 in 0.657s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fec0b5eb-0bbc-4b43-9bfb-c301584503ff tempest-VolumesExtendTest-2124769706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.689s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.190s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a353d2b1-019b-489d-a611-20c5f90146e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bc068386a834fc1a90f9bb0c78dc873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:40:20Z,use_quota=True,user_id='50e47a6feab8400586bdf03e49c0702a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:40:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Creating volume a353d2b1-019b-489d-a611-20c5f90146e5 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:40:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:40:20 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:40:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a353d2b1-019b-489d-a611-20c5f90146e5 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:20 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a353d2b1-019b-489d-a611-20c5f90146e5 1073741824 Jul 06 15:40:20 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:20 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-fec0b5eb-0bbc-4b43-9bfb-c301584503ff tempest-VolumesExtendTest-2124769706 None] Create snapshot completed successfully Jul 06 15:40:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7387a50f-fb06-4b64-a223-c123e3e5fda3 tempest-VolumesExtendTest-2124769706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:21 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a353d2b1-019b-489d-a611-20c5f90146e5 1073741824" returned: 0 in 0.899s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a353d2b1-019b-489d-a611-20c5f90146e5 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:21 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a353d2b1-019b-489d-a611-20c5f90146e5 Jul 06 15:40:21 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:21 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a353d2b1-019b-489d-a611-20c5f90146e5" returned: 0 in 0.634s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:40:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7387a50f-fb06-4b64-a223-c123e3e5fda3 tempest-VolumesExtendTest-2124769706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.874s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:21 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ed321f-73ad-4e20-a2b6-5d3b4dc1b58e]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7387a50f-fb06-4b64-a223-c123e3e5fda3 tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81aec5c4-716d-4a59-9e7e-ad4bf12f5668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a353d2b1-019b-489d-a611-20c5f90146e5', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (324a70b3-9f62-49ba-b958-3144006e2a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:21 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Volume volume-a353d2b1-019b-489d-a611-20c5f90146e5 (a353d2b1-019b-489d-a611-20c5f90146e5): created successfully Jul 06 15:40:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (324a70b3-9f62-49ba-b958-3144006e2a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Flow 'volume_create_manager' (42910daf-7036-49ed-9509-6bcb55462369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:40:21 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-d0b621a9-3363-4852-a8a4-c8696c7f3f17 tempest-CinderUnicodeTest-618632779 None] Created volume successfully. Jul 06 15:40:21 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86 Jul 06 15:40:21 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:22 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:40:22 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Flow 'volume_create_manager' (d822c9f4-ef38-4262-aa17-e3c9a6ae190f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:40:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e7a4ad-c3e9-4dac-b8be-623f0fc89b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7387a50f-fb06-4b64-a223-c123e3e5fda3 tempest-VolumesExtendTest-2124769706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86" returned: 0 in 0.839s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7387a50f-fb06-4b64-a223-c123e3e5fda3 tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.28fe61ae-2a50-429a-a88e-e9cee9b73b60 2G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e7a4ad-c3e9-4dac-b8be-623f0fc89b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:40:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1242185050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f3d1c4a-8c57-46ea-93fe-46491080963f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bc068386a834fc1a90f9bb0c78dc873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:40:22Z,use_quota=True,user_id='50e47a6feab8400586bdf03e49c0702a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78058dd7-a61c-4aff-8a81-b20d14b2f2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78058dd7-a61c-4aff-8a81-b20d14b2f2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a0a0f11-02f0-458e-b302-edb567891953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a0a0f11-02f0-458e-b302-edb567891953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f3d1c4a-8c57-46ea-93fe-46491080963f', 'volume_name': 'volume-3f3d1c4a-8c57-46ea-93fe-46491080963f', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1784d60-f1d9-47b7-81b6-6b02edd228ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1784d60-f1d9-47b7-81b6-6b02edd228ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07407511-0f46-4ffe-bd39-280efc95cbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:22 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Volume 3f3d1c4a-8c57-46ea-93fe-46491080963f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f3d1c4a-8c57-46ea-93fe-46491080963f', 'volume_size': 1} Jul 06 15:40:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7387a50f-fb06-4b64-a223-c123e3e5fda3 tempest-VolumesExtendTest-2124769706 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.28fe61ae-2a50-429a-a88e-e9cee9b73b60 2G" returned: 0 in 0.148s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7387a50f-fb06-4b64-a223-c123e3e5fda3 tempest-VolumesExtendTest-2124769706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.024s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.073s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:22 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:40:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1242185050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f3d1c4a-8c57-46ea-93fe-46491080963f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bc068386a834fc1a90f9bb0c78dc873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:40:22Z,use_quota=True,user_id='50e47a6feab8400586bdf03e49c0702a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:40:22 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Creating volume 3f3d1c4a-8c57-46ea-93fe-46491080963f {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:40:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:22 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:22 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:22 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:40:22 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:40:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:22 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f 1073741824 Jul 06 15:40:22 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:22 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-7387a50f-fb06-4b64-a223-c123e3e5fda3 tempest-VolumesExtendTest-2124769706 None] Extend volume completed successfully. Jul 06 15:40:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ebceccc9-677e-4734-8bf6-2629c0c96a50 tempest-VolumesExtendTest-2124769706 None] Acquiring lock "cinder-28fe61ae-2a50-429a-a88e-e9cee9b73b60-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ebceccc9-677e-4734-8bf6-2629c0c96a50 tempest-VolumesExtendTest-2124769706 None] Lock "cinder-28fe61ae-2a50-429a-a88e-e9cee9b73b60-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ebceccc9-677e-4734-8bf6-2629c0c96a50 tempest-VolumesExtendTest-2124769706 None] Acquiring lock "cinder-quobyte-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ebceccc9-677e-4734-8bf6-2629c0c96a50 tempest-VolumesExtendTest-2124769706 None] Lock "cinder-quobyte-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ebceccc9-677e-4734-8bf6-2629c0c96a50 tempest-VolumesExtendTest-2124769706 None] Acquiring lock "cinder-quobyte-28fe61ae-2a50-429a-a88e-e9cee9b73b60" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ebceccc9-677e-4734-8bf6-2629c0c96a50 tempest-VolumesExtendTest-2124769706 None] Lock "cinder-quobyte-28fe61ae-2a50-429a-a88e-e9cee9b73b60" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-ebceccc9-677e-4734-8bf6-2629c0c96a50 tempest-VolumesExtendTest-2124769706 None] Deleting offline snapshot 28fe61ae-2a50-429a-a88e-e9cee9b73b60 of volume 4b5f0ace-ab71-4b66-8d41-e9126cc8bc86 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:40:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-ebceccc9-677e-4734-8bf6-2629c0c96a50 tempest-VolumesExtendTest-2124769706 None] snapshot_file for this snap is: volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.28fe61ae-2a50-429a-a88e-e9cee9b73b60 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:40:23 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4daef5-3908-413b-9c47-62409107c6f2]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ebceccc9-677e-4734-8bf6-2629c0c96a50 tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.28fe61ae-2a50-429a-a88e-e9cee9b73b60 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:23 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.28fe61ae-2a50-429a-a88e-e9cee9b73b60 Jul 06 15:40:23 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:23 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f 1073741824" returned: 0 in 0.907s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:23 devstack sudo[101516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f Jul 06 15:40:23 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:24 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ebceccc9-677e-4734-8bf6-2629c0c96a50 tempest-VolumesExtendTest-2124769706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.28fe61ae-2a50-429a-a88e-e9cee9b73b60" returned: 0 in 0.786s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-ebceccc9-677e-4734-8bf6-2629c0c96a50 tempest-VolumesExtendTest-2124769706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:40:24 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc34a8e-9414-4cdd-ab7c-f783693f84e9]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ebceccc9-677e-4734-8bf6-2629c0c96a50 tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:24 devstack sudo[101521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86 Jul 06 15:40:24 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:24 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f" returned: 0 in 0.696s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:40:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07407511-0f46-4ffe-bd39-280efc95cbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f3d1c4a-8c57-46ea-93fe-46491080963f', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd377e9-db53-42b3-ba2b-12d02336f828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:24 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Volume volume-3f3d1c4a-8c57-46ea-93fe-46491080963f (3f3d1c4a-8c57-46ea-93fe-46491080963f): created successfully Jul 06 15:40:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd377e9-db53-42b3-ba2b-12d02336f828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Flow 'volume_create_manager' (d822c9f4-ef38-4262-aa17-e3c9a6ae190f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:40:24 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-59d9ad96-99b3-4c71-8b46-3c6e65962435 tempest-CinderUnicodeTest-618632779 None] Created volume successfully. Jul 06 15:40:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-420a44e4-d151-4df1-bcbb-0adfa26bcafd tempest-CinderUnicodeTest-618632779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-420a44e4-d151-4df1-bcbb-0adfa26bcafd tempest-CinderUnicodeTest-618632779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-420a44e4-d151-4df1-bcbb-0adfa26bcafd tempest-CinderUnicodeTest-618632779 None] Creating offline snapshot 2e4a5b1f-fb3c-4d30-92de-730264601d1b of volume 3f3d1c4a-8c57-46ea-93fe-46491080963f {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:40:24 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c63870-240e-4f6f-a9cb-4f081f4bb70f]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-420a44e4-d151-4df1-bcbb-0adfa26bcafd tempest-CinderUnicodeTest-618632779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:24 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ebceccc9-677e-4734-8bf6-2629c0c96a50 tempest-VolumesExtendTest-2124769706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86" returned: 0 in 0.845s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ebceccc9-677e-4734-8bf6-2629c0c96a50 tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.28fe61ae-2a50-429a-a88e-e9cee9b73b60 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:24 devstack sudo[101528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.28fe61ae-2a50-429a-a88e-e9cee9b73b60 Jul 06 15:40:24 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:24 devstack sudo[101527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f Jul 06 15:40:24 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:25 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-420a44e4-d151-4df1-bcbb-0adfa26bcafd tempest-CinderUnicodeTest-618632779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f" returned: 0 in 0.819s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-420a44e4-d151-4df1-bcbb-0adfa26bcafd tempest-CinderUnicodeTest-618632779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f.2e4a5b1f-fb3c-4d30-92de-730264601d1b 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:25 devstack sudo[101538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f.2e4a5b1f-fb3c-4d30-92de-730264601d1b 1G Jul 06 15:40:25 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:25 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ebceccc9-677e-4734-8bf6-2629c0c96a50 tempest-VolumesExtendTest-2124769706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.28fe61ae-2a50-429a-a88e-e9cee9b73b60" returned: 0 in 0.820s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ebceccc9-677e-4734-8bf6-2629c0c96a50 tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.28fe61ae-2a50-429a-a88e-e9cee9b73b60 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:25 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.28fe61ae-2a50-429a-a88e-e9cee9b73b60 Jul 06 15:40:25 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:26 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ebceccc9-677e-4734-8bf6-2629c0c96a50 tempest-VolumesExtendTest-2124769706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86.28fe61ae-2a50-429a-a88e-e9cee9b73b60" returned: 0 in 0.715s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ebceccc9-677e-4734-8bf6-2629c0c96a50 tempest-VolumesExtendTest-2124769706 None] Lock "cinder-quobyte-28fe61ae-2a50-429a-a88e-e9cee9b73b60" released by "_delete_snapshot" :: held 3.292s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ebceccc9-677e-4734-8bf6-2629c0c96a50 tempest-VolumesExtendTest-2124769706 None] Lock "cinder-quobyte-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86" released by "delete_snapshot" :: held 3.318s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:26 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-420a44e4-d151-4df1-bcbb-0adfa26bcafd tempest-CinderUnicodeTest-618632779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f.2e4a5b1f-fb3c-4d30-92de-730264601d1b 1G" returned: 0 in 0.889s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-420a44e4-d151-4df1-bcbb-0adfa26bcafd tempest-CinderUnicodeTest-618632779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f3d1c4a-8c57-46ea-93fe-46491080963f -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f.2e4a5b1f-fb3c-4d30-92de-730264601d1b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:26 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-ebceccc9-677e-4734-8bf6-2629c0c96a50 tempest-VolumesExtendTest-2124769706 None] Created reservations ['ca0f2cd3-6439-4046-863d-ca583c1133eb', 'b984ceb3-b13a-4c6e-9afd-5262e4528fe4', 'ee8c0f65-6621-4e9b-a903-3d07ab472954', '164b6fe1-81d1-49eb-bfdd-14bb578f57fa'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:40:26 devstack sudo[101547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f3d1c4a-8c57-46ea-93fe-46491080963f -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f.2e4a5b1f-fb3c-4d30-92de-730264601d1b Jul 06 15:40:26 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:26 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-ebceccc9-677e-4734-8bf6-2629c0c96a50 tempest-VolumesExtendTest-2124769706 None] Delete snapshot completed successfully. Jul 06 15:40:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ebceccc9-677e-4734-8bf6-2629c0c96a50 tempest-VolumesExtendTest-2124769706 None] Lock "cinder-28fe61ae-2a50-429a-a88e-e9cee9b73b60-delete_snapshot" released by "delete_snapshot" :: held 3.479s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:27 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-420a44e4-d151-4df1-bcbb-0adfa26bcafd tempest-CinderUnicodeTest-618632779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f3d1c4a-8c57-46ea-93fe-46491080963f -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f.2e4a5b1f-fb3c-4d30-92de-730264601d1b" returned: 0 in 0.684s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:27 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-420a44e4-d151-4df1-bcbb-0adfa26bcafd tempest-CinderUnicodeTest-618632779 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f.2e4a5b1f-fb3c-4d30-92de-730264601d1b is being set with open permissions: ugo+rw Jul 06 15:40:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-420a44e4-d151-4df1-bcbb-0adfa26bcafd tempest-CinderUnicodeTest-618632779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f.2e4a5b1f-fb3c-4d30-92de-730264601d1b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:27 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f.2e4a5b1f-fb3c-4d30-92de-730264601d1b Jul 06 15:40:27 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:27 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9d0c859f-d171-4531-84ca-ca4adf51120a tempest-VolumesExtendTest-2124769706 None] Acquiring lock "cinder-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:27 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9d0c859f-d171-4531-84ca-ca4adf51120a tempest-VolumesExtendTest-2124769706 None] Lock "cinder-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:27 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9d0c859f-d171-4531-84ca-ca4adf51120a tempest-VolumesExtendTest-2124769706 None] Acquiring lock "cinder-quobyte-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:27 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9d0c859f-d171-4531-84ca-ca4adf51120a tempest-VolumesExtendTest-2124769706 None] Lock "cinder-quobyte-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86" acquired by "delete_volume" :: waited 0.017s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:27 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb56caa-de80-451a-b49a-f884421ebf79]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9d0c859f-d171-4531-84ca-ca4adf51120a tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:27 devstack sudo[101554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86 Jul 06 15:40:27 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:27 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-420a44e4-d151-4df1-bcbb-0adfa26bcafd tempest-CinderUnicodeTest-618632779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f.2e4a5b1f-fb3c-4d30-92de-730264601d1b" returned: 0 in 0.676s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-420a44e4-d151-4df1-bcbb-0adfa26bcafd tempest-CinderUnicodeTest-618632779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:27 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f.info Jul 06 15:40:27 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:28 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9d0c859f-d171-4531-84ca-ca4adf51120a tempest-VolumesExtendTest-2124769706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86" returned: 0 in 0.837s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9d0c859f-d171-4531-84ca-ca4adf51120a tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:28 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86 Jul 06 15:40:28 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:28 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-420a44e4-d151-4df1-bcbb-0adfa26bcafd tempest-CinderUnicodeTest-618632779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f.info" returned: 0 in 0.819s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:28 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-420a44e4-d151-4df1-bcbb-0adfa26bcafd tempest-CinderUnicodeTest-618632779 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f.info is being set with open permissions: ugo+rw Jul 06 15:40:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-420a44e4-d151-4df1-bcbb-0adfa26bcafd tempest-CinderUnicodeTest-618632779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:28 devstack sudo[101565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f.info Jul 06 15:40:28 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:29 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9d0c859f-d171-4531-84ca-ca4adf51120a tempest-VolumesExtendTest-2124769706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86" returned: 0 in 0.795s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9d0c859f-d171-4531-84ca-ca4adf51120a tempest-VolumesExtendTest-2124769706 None] Lock "cinder-quobyte-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86" released by "delete_volume" :: held 1.698s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:29 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-9d0c859f-d171-4531-84ca-ca4adf51120a tempest-VolumesExtendTest-2124769706 None] Created reservations ['acb31e54-3cc2-4c09-af2a-567bb707dfbe', '46002096-f3b8-451d-b1c0-6634d8c1b9e2', '1fc402d6-e0be-4095-a49a-48199cb05d6e', 'b0989e17-852b-49d5-922e-ba54a2e67642'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:40:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9d0c859f-d171-4531-84ca-ca4adf51120a tempest-VolumesExtendTest-2124769706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9d0c859f-d171-4531-84ca-ca4adf51120a tempest-VolumesExtendTest-2124769706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:29 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-9d0c859f-d171-4531-84ca-ca4adf51120a tempest-VolumesExtendTest-2124769706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:29 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-9d0c859f-d171-4531-84ca-ca4adf51120a tempest-VolumesExtendTest-2124769706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9d0c859f-d171-4531-84ca-ca4adf51120a tempest-VolumesExtendTest-2124769706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9d0c859f-d171-4531-84ca-ca4adf51120a tempest-VolumesExtendTest-2124769706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:29 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-420a44e4-d151-4df1-bcbb-0adfa26bcafd tempest-CinderUnicodeTest-618632779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f.info" returned: 0 in 0.654s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:29 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:40:29 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-420a44e4-d151-4df1-bcbb-0adfa26bcafd tempest-CinderUnicodeTest-618632779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.642s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:29 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-420a44e4-d151-4df1-bcbb-0adfa26bcafd tempest-CinderUnicodeTest-618632779 None] Create snapshot completed successfully Jul 06 15:40:30 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-cf9b3601-cfe2-436a-84e5-8c8ed811dadd tempest-CinderUnicodeTest-618632779 None] Acquiring lock "cinder-2e4a5b1f-fb3c-4d30-92de-730264601d1b-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:30 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-cf9b3601-cfe2-436a-84e5-8c8ed811dadd tempest-CinderUnicodeTest-618632779 None] Lock "cinder-2e4a5b1f-fb3c-4d30-92de-730264601d1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:30 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:30 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-cf9b3601-cfe2-436a-84e5-8c8ed811dadd tempest-CinderUnicodeTest-618632779 None] Acquiring lock "cinder-quobyte-3f3d1c4a-8c57-46ea-93fe-46491080963f" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9d0c859f-d171-4531-84ca-ca4adf51120a tempest-VolumesExtendTest-2124769706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.739s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:30 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-9d0c859f-d171-4531-84ca-ca4adf51120a tempest-VolumesExtendTest-2124769706 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:40:30 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-9d0c859f-d171-4531-84ca-ca4adf51120a tempest-VolumesExtendTest-2124769706 None] Deleted volume successfully. Jul 06 15:40:30 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-cf9b3601-cfe2-436a-84e5-8c8ed811dadd tempest-CinderUnicodeTest-618632779 None] Lock "cinder-quobyte-3f3d1c4a-8c57-46ea-93fe-46491080963f" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:30 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-cf9b3601-cfe2-436a-84e5-8c8ed811dadd tempest-CinderUnicodeTest-618632779 None] Acquiring lock "cinder-quobyte-2e4a5b1f-fb3c-4d30-92de-730264601d1b" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:30 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-9d0c859f-d171-4531-84ca-ca4adf51120a tempest-VolumesExtendTest-2124769706 None] Lock "cinder-4b5f0ace-ab71-4b66-8d41-e9126cc8bc86-delete_volume" released by "delete_volume" :: held 2.684s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:30 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-cf9b3601-cfe2-436a-84e5-8c8ed811dadd tempest-CinderUnicodeTest-618632779 None] Lock "cinder-quobyte-2e4a5b1f-fb3c-4d30-92de-730264601d1b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-cf9b3601-cfe2-436a-84e5-8c8ed811dadd tempest-CinderUnicodeTest-618632779 None] Deleting offline snapshot 2e4a5b1f-fb3c-4d30-92de-730264601d1b of volume 3f3d1c4a-8c57-46ea-93fe-46491080963f {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:40:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-cf9b3601-cfe2-436a-84e5-8c8ed811dadd tempest-CinderUnicodeTest-618632779 None] snapshot_file for this snap is: volume-3f3d1c4a-8c57-46ea-93fe-46491080963f.2e4a5b1f-fb3c-4d30-92de-730264601d1b {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:40:30 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9c9ccc-3147-414e-b2ba-5f532e073d54]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cf9b3601-cfe2-436a-84e5-8c8ed811dadd tempest-CinderUnicodeTest-618632779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f.2e4a5b1f-fb3c-4d30-92de-730264601d1b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:30 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f.2e4a5b1f-fb3c-4d30-92de-730264601d1b Jul 06 15:40:30 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:31 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cf9b3601-cfe2-436a-84e5-8c8ed811dadd tempest-CinderUnicodeTest-618632779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f.2e4a5b1f-fb3c-4d30-92de-730264601d1b" returned: 0 in 0.856s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:31 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-cf9b3601-cfe2-436a-84e5-8c8ed811dadd tempest-CinderUnicodeTest-618632779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f3d1c4a-8c57-46ea-93fe-46491080963f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:40:31 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[527b15ea-042b-4c72-9490-621d6fb69200]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cf9b3601-cfe2-436a-84e5-8c8ed811dadd tempest-CinderUnicodeTest-618632779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:31 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f Jul 06 15:40:31 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:31 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cf9b3601-cfe2-436a-84e5-8c8ed811dadd tempest-CinderUnicodeTest-618632779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f" returned: 0 in 0.880s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cf9b3601-cfe2-436a-84e5-8c8ed811dadd tempest-CinderUnicodeTest-618632779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f.2e4a5b1f-fb3c-4d30-92de-730264601d1b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:32 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f.2e4a5b1f-fb3c-4d30-92de-730264601d1b Jul 06 15:40:32 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:32 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cf9b3601-cfe2-436a-84e5-8c8ed811dadd tempest-CinderUnicodeTest-618632779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f.2e4a5b1f-fb3c-4d30-92de-730264601d1b" returned: 0 in 0.964s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cf9b3601-cfe2-436a-84e5-8c8ed811dadd tempest-CinderUnicodeTest-618632779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f.2e4a5b1f-fb3c-4d30-92de-730264601d1b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:32 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f.2e4a5b1f-fb3c-4d30-92de-730264601d1b Jul 06 15:40:32 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:33 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:40:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Flow 'volume_create_manager' (11ab1ae2-83bb-4397-8317-c2c12e1216eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:40:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5060ab-d302-4847-83aa-489505b2b0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5060ab-d302-4847-83aa-489505b2b0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-933860460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0766f670-7424-4993-bf76-01a3e5d1d3e5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f28839379c014f2dbe5f049e4ed1981f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:40:33Z,use_quota=True,user_id='403e7e6d34d5466b917dfc9df3a9a19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a948085-1507-4888-9d1a-d7f010488415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a948085-1507-4888-9d1a-d7f010488415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319366ba-b982-499d-a303-760aaf1a1f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319366ba-b982-499d-a303-760aaf1a1f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0766f670-7424-4993-bf76-01a3e5d1d3e5', 'volume_name': 'volume-0766f670-7424-4993-bf76-01a3e5d1d3e5', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a07093ff-40cc-4333-9ce5-465378012bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a07093ff-40cc-4333-9ce5-465378012bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebfec313-6c81-48ec-be9c-6d6d33ebb9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:33 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Volume 0766f670-7424-4993-bf76-01a3e5d1d3e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0766f670-7424-4993-bf76-01a3e5d1d3e5', 'volume_size': 1} Jul 06 15:40:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-933860460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0766f670-7424-4993-bf76-01a3e5d1d3e5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f28839379c014f2dbe5f049e4ed1981f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:40:33Z,use_quota=True,user_id='403e7e6d34d5466b917dfc9df3a9a19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:40:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Creating volume 0766f670-7424-4993-bf76-01a3e5d1d3e5 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:40:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:40:33 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:40:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0766f670-7424-4993-bf76-01a3e5d1d3e5 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:33 devstack sudo[101591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0766f670-7424-4993-bf76-01a3e5d1d3e5 1073741824 Jul 06 15:40:33 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:33 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cf9b3601-cfe2-436a-84e5-8c8ed811dadd tempest-CinderUnicodeTest-618632779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f.2e4a5b1f-fb3c-4d30-92de-730264601d1b" returned: 0 in 0.715s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:33 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-cf9b3601-cfe2-436a-84e5-8c8ed811dadd tempest-CinderUnicodeTest-618632779 None] Lock "cinder-quobyte-2e4a5b1f-fb3c-4d30-92de-730264601d1b" released by "_delete_snapshot" :: held 3.549s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:33 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-cf9b3601-cfe2-436a-84e5-8c8ed811dadd tempest-CinderUnicodeTest-618632779 None] Lock "cinder-quobyte-3f3d1c4a-8c57-46ea-93fe-46491080963f" released by "delete_snapshot" :: held 3.585s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:33 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-cf9b3601-cfe2-436a-84e5-8c8ed811dadd tempest-CinderUnicodeTest-618632779 None] Created reservations ['5ab89a85-05d4-49e3-b2fd-0566a4297563', '1e752db8-86bd-4bae-ac83-d100032b0d69', '54ddd941-6e4f-4bed-9563-e339bd77391e', '65df5c74-c27f-41b0-a1ec-1ff2e6a332ea'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:40:33 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-cf9b3601-cfe2-436a-84e5-8c8ed811dadd tempest-CinderUnicodeTest-618632779 None] Delete snapshot completed successfully. Jul 06 15:40:33 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-cf9b3601-cfe2-436a-84e5-8c8ed811dadd tempest-CinderUnicodeTest-618632779 None] Lock "cinder-2e4a5b1f-fb3c-4d30-92de-730264601d1b-delete_snapshot" released by "delete_snapshot" :: held 3.768s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:34 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0766f670-7424-4993-bf76-01a3e5d1d3e5 1073741824" returned: 0 in 0.909s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0766f670-7424-4993-bf76-01a3e5d1d3e5 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:34 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0766f670-7424-4993-bf76-01a3e5d1d3e5 Jul 06 15:40:34 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:34 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a2ff188c-cf04-465c-b51a-64e1bc69ecef tempest-CinderUnicodeTest-618632779 None] Acquiring lock "cinder-3f3d1c4a-8c57-46ea-93fe-46491080963f-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:34 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a2ff188c-cf04-465c-b51a-64e1bc69ecef tempest-CinderUnicodeTest-618632779 None] Lock "cinder-3f3d1c4a-8c57-46ea-93fe-46491080963f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:34 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a2ff188c-cf04-465c-b51a-64e1bc69ecef tempest-CinderUnicodeTest-618632779 None] Acquiring lock "cinder-quobyte-3f3d1c4a-8c57-46ea-93fe-46491080963f" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:34 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a2ff188c-cf04-465c-b51a-64e1bc69ecef tempest-CinderUnicodeTest-618632779 None] Lock "cinder-quobyte-3f3d1c4a-8c57-46ea-93fe-46491080963f" acquired by "delete_volume" :: waited 0.040s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:34 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[057f1306-ac4e-4b63-a983-18d68a9d02f6]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a2ff188c-cf04-465c-b51a-64e1bc69ecef tempest-CinderUnicodeTest-618632779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:34 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f Jul 06 15:40:34 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:34 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0766f670-7424-4993-bf76-01a3e5d1d3e5" returned: 0 in 0.708s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:40:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebfec313-6c81-48ec-be9c-6d6d33ebb9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0766f670-7424-4993-bf76-01a3e5d1d3e5', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6849718a-34cf-40bb-b413-fd78119fb433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:34 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Volume volume-0766f670-7424-4993-bf76-01a3e5d1d3e5 (0766f670-7424-4993-bf76-01a3e5d1d3e5): created successfully Jul 06 15:40:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6849718a-34cf-40bb-b413-fd78119fb433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Flow 'volume_create_manager' (11ab1ae2-83bb-4397-8317-c2c12e1216eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:40:34 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-9b7084fd-6fe5-44cc-9cdc-27e2a8bdcc5a tempest-VolumesGetTest-1561494887 None] Created volume successfully. Jul 06 15:40:35 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a2ff188c-cf04-465c-b51a-64e1bc69ecef tempest-CinderUnicodeTest-618632779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f" returned: 0 in 0.824s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a2ff188c-cf04-465c-b51a-64e1bc69ecef tempest-CinderUnicodeTest-618632779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:35 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f Jul 06 15:40:35 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:35 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:40:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Flow 'volume_create_manager' (63451174-d35b-4d5a-8d97-e90416a73a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:40:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005afa52-62b1-4d00-af08-17bc07a7358f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005afa52-62b1-4d00-af08-17bc07a7358f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:40:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1329968177',display_name='tempest-VolumesGetTest-Volume-1371389816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=809901e0-cc68-4fa9-b0ee-8928a36b3437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f28839379c014f2dbe5f049e4ed1981f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:40:36Z,use_quota=True,user_id='403e7e6d34d5466b917dfc9df3a9a19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ec8cd82-686f-4ccc-9357-b4a5f193df83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ec8cd82-686f-4ccc-9357-b4a5f193df83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (309dca61-8b3c-4327-a88d-c4de7a8fd4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (309dca61-8b3c-4327-a88d-c4de7a8fd4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '809901e0-cc68-4fa9-b0ee-8928a36b3437', 'volume_name': 'volume-809901e0-cc68-4fa9-b0ee-8928a36b3437', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cae0e25-04b1-4af7-8d80-c7150083d2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cae0e25-04b1-4af7-8d80-c7150083d2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce78a44-a2bc-4528-88ab-1d4224545d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:36 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Volume 809901e0-cc68-4fa9-b0ee-8928a36b3437: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-809901e0-cc68-4fa9-b0ee-8928a36b3437', 'volume_size': 1} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:40:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1329968177',display_name='tempest-VolumesGetTest-Volume-1371389816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=809901e0-cc68-4fa9-b0ee-8928a36b3437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f28839379c014f2dbe5f049e4ed1981f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:40:36Z,use_quota=True,user_id='403e7e6d34d5466b917dfc9df3a9a19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Creating volume 809901e0-cc68-4fa9-b0ee-8928a36b3437 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:40:36 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-809901e0-cc68-4fa9-b0ee-8928a36b3437 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:36 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a2ff188c-cf04-465c-b51a-64e1bc69ecef tempest-CinderUnicodeTest-618632779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3f3d1c4a-8c57-46ea-93fe-46491080963f" returned: 0 in 0.736s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:36 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-809901e0-cc68-4fa9-b0ee-8928a36b3437 1073741824 Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a2ff188c-cf04-465c-b51a-64e1bc69ecef tempest-CinderUnicodeTest-618632779 None] Lock "cinder-quobyte-3f3d1c4a-8c57-46ea-93fe-46491080963f" released by "delete_volume" :: held 1.632s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:36 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-a2ff188c-cf04-465c-b51a-64e1bc69ecef tempest-CinderUnicodeTest-618632779 None] Created reservations ['ed63c4aa-0528-4beb-a618-c27600194f3b', 'aeff446e-0359-46af-ab43-278f77f12a14', 'c4904a86-50a7-47b6-862c-6aeeb6f8c0b1', '6fae13da-8f9b-4009-a2a2-5f45ef7c23db'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a2ff188c-cf04-465c-b51a-64e1bc69ecef tempest-CinderUnicodeTest-618632779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a2ff188c-cf04-465c-b51a-64e1bc69ecef tempest-CinderUnicodeTest-618632779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a2ff188c-cf04-465c-b51a-64e1bc69ecef tempest-CinderUnicodeTest-618632779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a2ff188c-cf04-465c-b51a-64e1bc69ecef tempest-CinderUnicodeTest-618632779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a2ff188c-cf04-465c-b51a-64e1bc69ecef tempest-CinderUnicodeTest-618632779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a2ff188c-cf04-465c-b51a-64e1bc69ecef tempest-CinderUnicodeTest-618632779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:36 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:40:36 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-de5eefa1-a4ce-4e25-956b-6bb27d81f16d tempest-CinderUnicodeTest-618632779 None] Acquiring lock "cinder-a353d2b1-019b-489d-a611-20c5f90146e5-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-de5eefa1-a4ce-4e25-956b-6bb27d81f16d tempest-CinderUnicodeTest-618632779 None] Lock "cinder-a353d2b1-019b-489d-a611-20c5f90146e5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-de5eefa1-a4ce-4e25-956b-6bb27d81f16d tempest-CinderUnicodeTest-618632779 None] Acquiring lock "cinder-quobyte-a353d2b1-019b-489d-a611-20c5f90146e5" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-de5eefa1-a4ce-4e25-956b-6bb27d81f16d tempest-CinderUnicodeTest-618632779 None] Lock "cinder-quobyte-a353d2b1-019b-489d-a611-20c5f90146e5" acquired by "delete_volume" :: waited 0.024s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c2d2b6-7652-4d29-8195-b32460688855]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-de5eefa1-a4ce-4e25-956b-6bb27d81f16d tempest-CinderUnicodeTest-618632779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a353d2b1-019b-489d-a611-20c5f90146e5 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:37 devstack sudo[101618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a353d2b1-019b-489d-a611-20c5f90146e5 Jul 06 15:40:37 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:37 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a2ff188c-cf04-465c-b51a-64e1bc69ecef tempest-CinderUnicodeTest-618632779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.845s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:37 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-a2ff188c-cf04-465c-b51a-64e1bc69ecef tempest-CinderUnicodeTest-618632779 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:40:37 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a2ff188c-cf04-465c-b51a-64e1bc69ecef tempest-CinderUnicodeTest-618632779 None] Deleted volume successfully. Jul 06 15:40:37 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=140,cinder:INSERT=48,cinder:UPDATE=165,cinder:DELETE=16 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:40:37 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a2ff188c-cf04-465c-b51a-64e1bc69ecef tempest-CinderUnicodeTest-618632779 None] Lock "cinder-3f3d1c4a-8c57-46ea-93fe-46491080963f-delete_volume" released by "delete_volume" :: held 2.752s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:37 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-809901e0-cc68-4fa9-b0ee-8928a36b3437 1073741824" returned: 0 in 1.083s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:37 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:UPDATE=166,cinder:DELETE=10,cinder:SELECT=118,cinder:INSERT=52 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:40:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-809901e0-cc68-4fa9-b0ee-8928a36b3437 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:37 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-809901e0-cc68-4fa9-b0ee-8928a36b3437 Jul 06 15:40:37 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:37 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-de5eefa1-a4ce-4e25-956b-6bb27d81f16d tempest-CinderUnicodeTest-618632779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a353d2b1-019b-489d-a611-20c5f90146e5" returned: 0 in 0.874s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-de5eefa1-a4ce-4e25-956b-6bb27d81f16d tempest-CinderUnicodeTest-618632779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a353d2b1-019b-489d-a611-20c5f90146e5 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:37 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a353d2b1-019b-489d-a611-20c5f90146e5 Jul 06 15:40:37 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:37 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-809901e0-cc68-4fa9-b0ee-8928a36b3437" returned: 0 in 0.751s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] <== create_volume: return (1892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:40:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.894s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:37 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce78a44-a2bc-4528-88ab-1d4224545d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-809901e0-cc68-4fa9-b0ee-8928a36b3437', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90668e3a-6c68-4142-8523-cfa4428bd60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:38 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Volume volume-809901e0-cc68-4fa9-b0ee-8928a36b3437 (809901e0-cc68-4fa9-b0ee-8928a36b3437): created successfully Jul 06 15:40:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90668e3a-6c68-4142-8523-cfa4428bd60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Flow 'volume_create_manager' (63451174-d35b-4d5a-8d97-e90416a73a86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:40:38 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-2e718b11-4e2b-4cb0-9a3d-e0a83872e53e tempest-VolumesGetTest-1561494887 None] Created volume successfully. Jul 06 15:40:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:40:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:38 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:40:38 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:38 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-de5eefa1-a4ce-4e25-956b-6bb27d81f16d tempest-CinderUnicodeTest-618632779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a353d2b1-019b-489d-a611-20c5f90146e5" returned: 0 in 0.843s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-de5eefa1-a4ce-4e25-956b-6bb27d81f16d tempest-CinderUnicodeTest-618632779 None] Lock "cinder-quobyte-a353d2b1-019b-489d-a611-20c5f90146e5" released by "delete_volume" :: held 1.770s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:38 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-de5eefa1-a4ce-4e25-956b-6bb27d81f16d tempest-CinderUnicodeTest-618632779 None] Created reservations ['6876adf8-f6ed-41c2-aebd-f0997ac4ff7c', 'e2afd561-8d0c-4797-98b2-8f228c9024f5', '632bf502-e6a3-402b-a49f-c90012d2fcbc', 'c4fd673a-9502-48dc-aa97-2010a5d33a69'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:40:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-de5eefa1-a4ce-4e25-956b-6bb27d81f16d tempest-CinderUnicodeTest-618632779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-de5eefa1-a4ce-4e25-956b-6bb27d81f16d tempest-CinderUnicodeTest-618632779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-de5eefa1-a4ce-4e25-956b-6bb27d81f16d tempest-CinderUnicodeTest-618632779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-de5eefa1-a4ce-4e25-956b-6bb27d81f16d tempest-CinderUnicodeTest-618632779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-de5eefa1-a4ce-4e25-956b-6bb27d81f16d tempest-CinderUnicodeTest-618632779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-de5eefa1-a4ce-4e25-956b-6bb27d81f16d tempest-CinderUnicodeTest-618632779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:38 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:40:38 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:39 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-524e2f26-afd8-404a-9957-a63d1ec1ab9a tempest-VolumesGetTest-1561494887 None] Acquiring lock "cinder-809901e0-cc68-4fa9-b0ee-8928a36b3437-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:39 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-524e2f26-afd8-404a-9957-a63d1ec1ab9a tempest-VolumesGetTest-1561494887 None] Lock "cinder-809901e0-cc68-4fa9-b0ee-8928a36b3437-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:39 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-524e2f26-afd8-404a-9957-a63d1ec1ab9a tempest-VolumesGetTest-1561494887 None] Acquiring lock "cinder-quobyte-809901e0-cc68-4fa9-b0ee-8928a36b3437" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:39 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-524e2f26-afd8-404a-9957-a63d1ec1ab9a tempest-VolumesGetTest-1561494887 None] Lock "cinder-quobyte-809901e0-cc68-4fa9-b0ee-8928a36b3437" acquired by "delete_volume" :: waited 0.032s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:39 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f386b8d-3f1c-464f-a88b-48cf2a2a6d7f]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-524e2f26-afd8-404a-9957-a63d1ec1ab9a tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-809901e0-cc68-4fa9-b0ee-8928a36b3437 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:39 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.246s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:40:39 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager._thread_info {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:40:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread count: 28 {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:40:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread info: [<_MainThread(MainThread, started 124857273856128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:40:39 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-de5eefa1-a4ce-4e25-956b-6bb27d81f16d tempest-CinderUnicodeTest-618632779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.898s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-de5eefa1-a4ce-4e25-956b-6bb27d81f16d tempest-CinderUnicodeTest-618632779 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:40:39 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-de5eefa1-a4ce-4e25-956b-6bb27d81f16d tempest-CinderUnicodeTest-618632779 None] Deleted volume successfully. Jul 06 15:40:39 devstack sudo[101637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-809901e0-cc68-4fa9-b0ee-8928a36b3437 Jul 06 15:40:39 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:39 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-de5eefa1-a4ce-4e25-956b-6bb27d81f16d tempest-CinderUnicodeTest-618632779 None] Lock "cinder-a353d2b1-019b-489d-a611-20c5f90146e5-delete_volume" released by "delete_volume" :: held 3.098s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:40 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-524e2f26-afd8-404a-9957-a63d1ec1ab9a tempest-VolumesGetTest-1561494887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-809901e0-cc68-4fa9-b0ee-8928a36b3437" returned: 0 in 0.932s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-524e2f26-afd8-404a-9957-a63d1ec1ab9a tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-809901e0-cc68-4fa9-b0ee-8928a36b3437 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:40 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-809901e0-cc68-4fa9-b0ee-8928a36b3437 Jul 06 15:40:40 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:41 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-524e2f26-afd8-404a-9957-a63d1ec1ab9a tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-809901e0-cc68-4fa9-b0ee-8928a36b3437" returned: 0 in 0.705s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-524e2f26-afd8-404a-9957-a63d1ec1ab9a tempest-VolumesGetTest-1561494887 None] Lock "cinder-quobyte-809901e0-cc68-4fa9-b0ee-8928a36b3437" released by "delete_volume" :: held 1.711s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:41 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-524e2f26-afd8-404a-9957-a63d1ec1ab9a tempest-VolumesGetTest-1561494887 None] Created reservations ['0f3f32ba-aa19-4e70-8670-918231b2decb', '4bf96dbc-d7c4-41f2-8db9-9b78b0f87608', '74533aad-8a35-4b9f-b34e-d35b74a1f042', '61cf1fa9-cbff-4504-b5c3-5e977cd51c62'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:40:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-524e2f26-afd8-404a-9957-a63d1ec1ab9a tempest-VolumesGetTest-1561494887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-524e2f26-afd8-404a-9957-a63d1ec1ab9a tempest-VolumesGetTest-1561494887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:41 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-524e2f26-afd8-404a-9957-a63d1ec1ab9a tempest-VolumesGetTest-1561494887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:41 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-524e2f26-afd8-404a-9957-a63d1ec1ab9a tempest-VolumesGetTest-1561494887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-524e2f26-afd8-404a-9957-a63d1ec1ab9a tempest-VolumesGetTest-1561494887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-524e2f26-afd8-404a-9957-a63d1ec1ab9a tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:41 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:40:41 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6dd6f6da-8388-4117-8af6-42228de57dc4 tempest-VolumesGetTest-1561494887 None] Acquiring lock "cinder-0766f670-7424-4993-bf76-01a3e5d1d3e5-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6dd6f6da-8388-4117-8af6-42228de57dc4 tempest-VolumesGetTest-1561494887 None] Lock "cinder-0766f670-7424-4993-bf76-01a3e5d1d3e5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:42 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6dd6f6da-8388-4117-8af6-42228de57dc4 tempest-VolumesGetTest-1561494887 None] Acquiring lock "cinder-quobyte-0766f670-7424-4993-bf76-01a3e5d1d3e5" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:42 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6dd6f6da-8388-4117-8af6-42228de57dc4 tempest-VolumesGetTest-1561494887 None] Lock "cinder-quobyte-0766f670-7424-4993-bf76-01a3e5d1d3e5" acquired by "delete_volume" :: waited 0.023s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:42 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b78770c-7483-4bd7-acdb-9ff654b1b317]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6dd6f6da-8388-4117-8af6-42228de57dc4 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0766f670-7424-4993-bf76-01a3e5d1d3e5 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:42 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0766f670-7424-4993-bf76-01a3e5d1d3e5 Jul 06 15:40:42 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:42 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-524e2f26-afd8-404a-9957-a63d1ec1ab9a tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.853s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:42 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-524e2f26-afd8-404a-9957-a63d1ec1ab9a tempest-VolumesGetTest-1561494887 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:40:42 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-524e2f26-afd8-404a-9957-a63d1ec1ab9a tempest-VolumesGetTest-1561494887 None] Deleted volume successfully. Jul 06 15:40:42 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-524e2f26-afd8-404a-9957-a63d1ec1ab9a tempest-VolumesGetTest-1561494887 None] Lock "cinder-809901e0-cc68-4fa9-b0ee-8928a36b3437-delete_volume" released by "delete_volume" :: held 2.869s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:43 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6dd6f6da-8388-4117-8af6-42228de57dc4 tempest-VolumesGetTest-1561494887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0766f670-7424-4993-bf76-01a3e5d1d3e5" returned: 0 in 1.019s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6dd6f6da-8388-4117-8af6-42228de57dc4 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0766f670-7424-4993-bf76-01a3e5d1d3e5 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:43 devstack sudo[101688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0766f670-7424-4993-bf76-01a3e5d1d3e5 Jul 06 15:40:43 devstack sudo[101688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:43 devstack sudo[101688]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6dd6f6da-8388-4117-8af6-42228de57dc4 tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0766f670-7424-4993-bf76-01a3e5d1d3e5" returned: 0 in 0.736s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6dd6f6da-8388-4117-8af6-42228de57dc4 tempest-VolumesGetTest-1561494887 None] Lock "cinder-quobyte-0766f670-7424-4993-bf76-01a3e5d1d3e5" released by "delete_volume" :: held 1.820s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:43 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-6dd6f6da-8388-4117-8af6-42228de57dc4 tempest-VolumesGetTest-1561494887 None] Created reservations ['3e367973-d942-477b-b171-2f7339c697b5', '78c5b6de-46ab-4f80-8d0b-b3e91d41228c', '74f68c1b-5ad8-4681-8daf-d185b24742c4', '5ba0479f-8eaf-4cfe-8d14-72057806235c'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:40:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6dd6f6da-8388-4117-8af6-42228de57dc4 tempest-VolumesGetTest-1561494887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6dd6f6da-8388-4117-8af6-42228de57dc4 tempest-VolumesGetTest-1561494887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6dd6f6da-8388-4117-8af6-42228de57dc4 tempest-VolumesGetTest-1561494887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6dd6f6da-8388-4117-8af6-42228de57dc4 tempest-VolumesGetTest-1561494887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6dd6f6da-8388-4117-8af6-42228de57dc4 tempest-VolumesGetTest-1561494887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6dd6f6da-8388-4117-8af6-42228de57dc4 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:44 devstack sudo[101693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:40:44 devstack sudo[101693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:44 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:40:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Flow 'volume_create_manager' (e117ed70-be4d-414a-8d02-77b72c6f6da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:40:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87819f66-a278-4824-8e35-e65d5dcef495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87819f66-a278-4824-8e35-e65d5dcef495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1240790833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f16ceb4c-3408-476a-b9c6-7c8e98b1e705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f28839379c014f2dbe5f049e4ed1981f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:40:45Z,use_quota=True,user_id='403e7e6d34d5466b917dfc9df3a9a19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:44 devstack sudo[101693]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b449f15-13aa-4c39-a9bc-5f2e217e7fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b449f15-13aa-4c39-a9bc-5f2e217e7fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ef2516-388a-48a6-91a4-244312cff6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ef2516-388a-48a6-91a4-244312cff6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f16ceb4c-3408-476a-b9c6-7c8e98b1e705', 'volume_name': 'volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cb48289-8aa3-410d-abfc-59bcf166a254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cb48289-8aa3-410d-abfc-59bcf166a254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1beb38e2-f77e-487d-858d-e7abde062ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:44 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Volume f16ceb4c-3408-476a-b9c6-7c8e98b1e705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705', 'volume_size': 1} Jul 06 15:40:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1240790833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f16ceb4c-3408-476a-b9c6-7c8e98b1e705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f28839379c014f2dbe5f049e4ed1981f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:40:45Z,use_quota=True,user_id='403e7e6d34d5466b917dfc9df3a9a19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:40:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Creating volume f16ceb4c-3408-476a-b9c6-7c8e98b1e705 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:40:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:40:44 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:40:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6dd6f6da-8388-4117-8af6-42228de57dc4 tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.960s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:44 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-6dd6f6da-8388-4117-8af6-42228de57dc4 tempest-VolumesGetTest-1561494887 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:40:44 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-6dd6f6da-8388-4117-8af6-42228de57dc4 tempest-VolumesGetTest-1561494887 None] Deleted volume successfully. Jul 06 15:40:44 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705 1073741824 Jul 06 15:40:44 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:45 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6dd6f6da-8388-4117-8af6-42228de57dc4 tempest-VolumesGetTest-1561494887 None] Lock "cinder-0766f670-7424-4993-bf76-01a3e5d1d3e5-delete_volume" released by "delete_volume" :: held 3.081s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:45 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705 1073741824" returned: 0 in 0.991s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:46 devstack sudo[101702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705 Jul 06 15:40:46 devstack sudo[101702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:46 devstack sudo[101702]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705" returned: 0 in 0.878s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] <== create_volume: return (1933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:40:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.936s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1beb38e2-f77e-487d-858d-e7abde062ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a6e4549-57e0-48e6-842f-25dc28b98b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:46 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Volume volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705 (f16ceb4c-3408-476a-b9c6-7c8e98b1e705): created successfully Jul 06 15:40:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a6e4549-57e0-48e6-842f-25dc28b98b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Flow 'volume_create_manager' (e117ed70-be4d-414a-8d02-77b72c6f6da9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:40:46 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-9b9b92f1-5b99-45aa-9b6a-5ed9f2c30980 tempest-VolumesGetTest-1561494887 None] Created volume successfully. Jul 06 15:40:47 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:40:47 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Flow 'volume_create_manager' (8864734d-772b-4b5d-a099-f3ebdc244e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:40:47 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6355b6db-fd88-4ae7-a858-525394481b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:47 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6355b6db-fd88-4ae7-a858-525394481b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1223860130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee62bfd2-a6cf-42bd-a699-6ccb515072f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c39294b3ac4104882c85261edc75e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:40:47Z,use_quota=True,user_id='de42c12e4a864fc78854d0e21972a577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:47 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c0d61e-0c22-471f-8ed7-e50fd9a5f1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:47 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c0d61e-0c22-471f-8ed7-e50fd9a5f1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:47 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e95113-ab5c-4fb6-95f7-326695cb0466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:47 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e95113-ab5c-4fb6-95f7-326695cb0466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee62bfd2-a6cf-42bd-a699-6ccb515072f6', 'volume_name': 'volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:47 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb252f3c-2688-4998-9458-c842d8a23edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:47 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb252f3c-2688-4998-9458-c842d8a23edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:47 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b09150-ff82-4245-82c3-f301be7cf4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:47 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Volume ee62bfd2-a6cf-42bd-a699-6ccb515072f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6', 'volume_size': 1} Jul 06 15:40:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:47 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1223860130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee62bfd2-a6cf-42bd-a699-6ccb515072f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c39294b3ac4104882c85261edc75e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:40:47Z,use_quota=True,user_id='de42c12e4a864fc78854d0e21972a577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:40:47 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Creating volume ee62bfd2-a6cf-42bd-a699-6ccb515072f6 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:40:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:47 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:47 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:47 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:40:47 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:40:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:47 devstack sudo[101706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6 1073741824 Jul 06 15:40:47 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:48 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:40:48 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Flow 'volume_create_manager' (e34f552d-9ef7-4bbb-9d0f-6e674c44ac77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:40:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96db621-fd64-4c37-82b3-4a3977ed59c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6 1073741824" returned: 0 in 0.937s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96db621-fd64-4c37-82b3-4a3977ed59c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-675213703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4210f00-56f0-4e9e-9858-1edc759d2f5d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f28839379c014f2dbe5f049e4ed1981f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f16ceb4c-3408-476a-b9c6-7c8e98b1e705,status='creating',terminated_at=None,updated_at=2026-07-06T13:40:48Z,use_quota=True,user_id='403e7e6d34d5466b917dfc9df3a9a19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d45049-46c5-4cf9-aefa-675ecd0b1cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d45049-46c5-4cf9-aefa-675ecd0b1cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f931e74-1478-4b83-ac4e-09e78c52db34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f931e74-1478-4b83-ac4e-09e78c52db34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e4210f00-56f0-4e9e-9858-1edc759d2f5d', 'volume_name': 'volume-e4210f00-56f0-4e9e-9858-1edc759d2f5d', 'volume_size': 1, 'source_volid': 'f16ceb4c-3408-476a-b9c6-7c8e98b1e705', 'source_volstatus': 'available'}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a20737-bf0e-4a80-948e-1cc0f465dd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a20737-bf0e-4a80-948e-1cc0f465dd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4704519c-68de-4341-9d8e-087f3c5c0486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:48 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Volume e4210f00-56f0-4e9e-9858-1edc759d2f5d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e4210f00-56f0-4e9e-9858-1edc759d2f5d', 'volume_size': 1, 'source_volid': 'f16ceb4c-3408-476a-b9c6-7c8e98b1e705', 'source_volstatus': 'available'} Jul 06 15:40:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:48 devstack sudo[101712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6 Jul 06 15:40:48 devstack sudo[101712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:49 devstack sudo[101712]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6" returned: 0 in 0.657s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:40:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.667s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:49 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Cloning volume f16ceb4c-3408-476a-b9c6-7c8e98b1e705 to volume e4210f00-56f0-4e9e-9858-1edc759d2f5d Jul 06 15:40:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b09150-ff82-4245-82c3-f301be7cf4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ddfafae-1b8c-43bd-b5b7-286934afad85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:49 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Volume volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6 (ee62bfd2-a6cf-42bd-a699-6ccb515072f6): created successfully Jul 06 15:40:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ddfafae-1b8c-43bd-b5b7-286934afad85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Flow 'volume_create_manager' (8864734d-772b-4b5d-a099-f3ebdc244e81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:40:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Creating offline snapshot b3621dcf-7322-439c-ac96-a6e144c1fa9c of volume f16ceb4c-3408-476a-b9c6-7c8e98b1e705 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:40:49 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a68b38d4-b925-4a61-b14d-e3649eba0fd9 tempest-SnapshotDependencyTests-1172348225 None] Created volume successfully. Jul 06 15:40:49 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6c25aa-67f1-45f7-8ebe-c2e15dc51fd5]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:49 devstack sudo[101716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705 Jul 06 15:40:49 devstack sudo[101716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f99b081e-c8da-4a94-88da-2c62d046f72a tempest-SnapshotDependencyTests-1172348225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:50 devstack sudo[101716]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705" returned: 0 in 0.843s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.b3621dcf-7322-439c-ac96-a6e144c1fa9c 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:50 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.b3621dcf-7322-439c-ac96-a6e144c1fa9c 1G Jul 06 15:40:50 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:51 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.b3621dcf-7322-439c-ac96-a6e144c1fa9c 1G" returned: 0 in 0.817s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.b3621dcf-7322-439c-ac96-a6e144c1fa9c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:51 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.b3621dcf-7322-439c-ac96-a6e144c1fa9c Jul 06 15:40:51 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:51 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.b3621dcf-7322-439c-ac96-a6e144c1fa9c" returned: 0 in 0.696s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:51 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.b3621dcf-7322-439c-ac96-a6e144c1fa9c is being set with open permissions: ugo+rw Jul 06 15:40:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.b3621dcf-7322-439c-ac96-a6e144c1fa9c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:51 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.b3621dcf-7322-439c-ac96-a6e144c1fa9c Jul 06 15:40:51 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:52 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.b3621dcf-7322-439c-ac96-a6e144c1fa9c" returned: 0 in 0.629s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:52 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.info Jul 06 15:40:52 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:53 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.info" returned: 0 in 0.618s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:53 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.info is being set with open permissions: ugo+rw Jul 06 15:40:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:53 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.info Jul 06 15:40:53 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:53 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.info" returned: 0 in 0.656s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:53 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Acquiring lock "cinder-quobyte-e4210f00-56f0-4e9e-9858-1edc759d2f5d" by "_copy_volume_from_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:53 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Lock "cinder-quobyte-e4210f00-56f0-4e9e-9858-1edc759d2f5d" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:53 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] snapshot: b3621dcf-7322-439c-ac96-a6e144c1fa9c, volume: e4210f00-56f0-4e9e-9858-1edc759d2f5d, {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 15:40:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:53 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:53 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:53 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[089d39a0-c6a2-4dfa-bb9a-6e22fc78932a]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.b3621dcf-7322-439c-ac96-a6e144c1fa9c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:53 devstack sudo[101747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.b3621dcf-7322-439c-ac96-a6e144c1fa9c Jul 06 15:40:53 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:54 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.b3621dcf-7322-439c-ac96-a6e144c1fa9c" returned: 0 in 0.756s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:40:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705 {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 15:40:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Creating direct copy from snapshot {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 15:40:54 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0508cd-b930-4500-ba15-db22e3ec8f00]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:54 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705 Jul 06 15:40:54 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:55 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705" returned: 0 in 0.764s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:55 devstack cinder-volume[86148]: DEBUG cinder.utils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Path /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e4210f00-56f0-4e9e-9858-1edc759d2f5d not found in is_blk_device check {{(pid=86148) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 15:40:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e4210f00-56f0-4e9e-9858-1edc759d2f5d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:55 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e4210f00-56f0-4e9e-9858-1edc759d2f5d Jul 06 15:40:55 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:59 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e4210f00-56f0-4e9e-9858-1edc759d2f5d" returned: 0 in 4.411s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:59 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac57ff8f-b06a-46da-a25c-f7d32559b8a0]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:59 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705 Jul 06 15:40:59 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:00 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705" returned: 0 in 0.926s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:00 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705, size 1024.00 MB, duration 4.41 sec, destination /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e4210f00-56f0-4e9e-9858-1edc759d2f5d {{(pid=86148) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:41:00 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Converted 1024.00 MB image at 232.07 MB/s Jul 06 15:41:00 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e4210f00-56f0-4e9e-9858-1edc759d2f5d is being set with open permissions: ugo+rw Jul 06 15:41:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e4210f00-56f0-4e9e-9858-1edc759d2f5d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:00 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e4210f00-56f0-4e9e-9858-1edc759d2f5d Jul 06 15:41:00 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:01 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e4210f00-56f0-4e9e-9858-1edc759d2f5d" returned: 0 in 0.615s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:01 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Lock "cinder-quobyte-e4210f00-56f0-4e9e-9858-1edc759d2f5d" released by "_copy_volume_from_snapshot" :: held 7.553s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:01 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Acquiring lock "cinder-quobyte-b3621dcf-7322-439c-ac96-a6e144c1fa9c" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:01 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Lock "cinder-quobyte-b3621dcf-7322-439c-ac96-a6e144c1fa9c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Deleting offline snapshot b3621dcf-7322-439c-ac96-a6e144c1fa9c of volume f16ceb4c-3408-476a-b9c6-7c8e98b1e705 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:41:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] snapshot_file for this snap is: volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.b3621dcf-7322-439c-ac96-a6e144c1fa9c {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:41:01 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a76ee9a-6ccc-498e-83da-7039a1f6ea29]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.b3621dcf-7322-439c-ac96-a6e144c1fa9c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:01 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.b3621dcf-7322-439c-ac96-a6e144c1fa9c Jul 06 15:41:01 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:02 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.b3621dcf-7322-439c-ac96-a6e144c1fa9c" returned: 0 in 0.757s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:02 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:41:02 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f3824c-5236-4971-b4ce-30924b38b83c]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:02 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705 Jul 06 15:41:02 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:02 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:UPDATE=34,cinder:SELECT=24,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:41:02 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705" returned: 0 in 0.720s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.b3621dcf-7322-439c-ac96-a6e144c1fa9c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:02 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.b3621dcf-7322-439c-ac96-a6e144c1fa9c Jul 06 15:41:02 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:03 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.b3621dcf-7322-439c-ac96-a6e144c1fa9c" returned: 0 in 0.730s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.b3621dcf-7322-439c-ac96-a6e144c1fa9c {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:03 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.b3621dcf-7322-439c-ac96-a6e144c1fa9c Jul 06 15:41:03 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:04 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705.b3621dcf-7322-439c-ac96-a6e144c1fa9c" returned: 0 in 0.642s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:04 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Lock "cinder-quobyte-b3621dcf-7322-439c-ac96-a6e144c1fa9c" released by "_delete_snapshot" :: held 2.938s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.977s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f99b081e-c8da-4a94-88da-2c62d046f72a tempest-SnapshotDependencyTests-1172348225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.443s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:04 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-f99b081e-c8da-4a94-88da-2c62d046f72a tempest-SnapshotDependencyTests-1172348225 None] Creating offline snapshot 27abf13e-5519-4f6e-bde6-d3503509a4fc of volume ee62bfd2-a6cf-42bd-a699-6ccb515072f6 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:41:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4704519c-68de-4341-9d8e-087f3c5c0486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4210f00-56f0-4e9e-9858-1edc759d2f5d', 'volume_size': 1, 'source_volid': 'f16ceb4c-3408-476a-b9c6-7c8e98b1e705', 'source_volstatus': 'available'}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc584606-7367-44f7-b9b3-19b306309146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:04 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f1d076-3239-45cb-a64b-e8e614c67f7f]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f99b081e-c8da-4a94-88da-2c62d046f72a tempest-SnapshotDependencyTests-1172348225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:04 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Volume volume-e4210f00-56f0-4e9e-9858-1edc759d2f5d (e4210f00-56f0-4e9e-9858-1edc759d2f5d): created successfully Jul 06 15:41:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc584606-7367-44f7-b9b3-19b306309146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:04 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Flow 'volume_create_manager' (e34f552d-9ef7-4bbb-9d0f-6e674c44ac77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:41:04 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-b4798984-f476-4172-928a-b28099ea7a1d tempest-VolumesGetTest-1561494887 None] Created volume successfully. Jul 06 15:41:04 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6 Jul 06 15:41:04 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:05 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f99b081e-c8da-4a94-88da-2c62d046f72a tempest-SnapshotDependencyTests-1172348225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6" returned: 0 in 0.775s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f99b081e-c8da-4a94-88da-2c62d046f72a tempest-SnapshotDependencyTests-1172348225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.27abf13e-5519-4f6e-bde6-d3503509a4fc 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:05 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.27abf13e-5519-4f6e-bde6-d3503509a4fc 1G Jul 06 15:41:05 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:05 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:41:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Flow 'volume_create_manager' (669b9b79-a17d-43a8-83e0-31f056995f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:41:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b23be1-7bbc-449c-a035-48b63d486810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b23be1-7bbc-449c-a035-48b63d486810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:41:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2115834068',display_name='tempest-VolumesGetTest-Volume-1392211495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da00d5e3-5c1e-4938-ba22-b79a7a4247d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f28839379c014f2dbe5f049e4ed1981f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:05Z,use_quota=True,user_id='403e7e6d34d5466b917dfc9df3a9a19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a753254-99ae-4efa-96a2-a7f6c3e33565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a753254-99ae-4efa-96a2-a7f6c3e33565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d66957a6-b06c-45c0-bdf8-83d2d8f8bfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d66957a6-b06c-45c0-bdf8-83d2d8f8bfd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da00d5e3-5c1e-4938-ba22-b79a7a4247d8', 'volume_name': 'volume-da00d5e3-5c1e-4938-ba22-b79a7a4247d8', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b464a3-3333-48f1-b9f6-53cc8363a139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b464a3-3333-48f1-b9f6-53cc8363a139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604a7cb5-8206-4a43-8a21-e78ac108deea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:05 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Volume da00d5e3-5c1e-4938-ba22-b79a7a4247d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da00d5e3-5c1e-4938-ba22-b79a7a4247d8', 'volume_size': 1} Jul 06 15:41:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:05 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f99b081e-c8da-4a94-88da-2c62d046f72a tempest-SnapshotDependencyTests-1172348225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.27abf13e-5519-4f6e-bde6-d3503509a4fc 1G" returned: 0 in 0.777s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f99b081e-c8da-4a94-88da-2c62d046f72a tempest-SnapshotDependencyTests-1172348225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.27abf13e-5519-4f6e-bde6-d3503509a4fc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:05 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.27abf13e-5519-4f6e-bde6-d3503509a4fc Jul 06 15:41:05 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:06 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f99b081e-c8da-4a94-88da-2c62d046f72a tempest-SnapshotDependencyTests-1172348225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.27abf13e-5519-4f6e-bde6-d3503509a4fc" returned: 0 in 0.652s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:06 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-f99b081e-c8da-4a94-88da-2c62d046f72a tempest-SnapshotDependencyTests-1172348225 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.27abf13e-5519-4f6e-bde6-d3503509a4fc is being set with open permissions: ugo+rw Jul 06 15:41:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f99b081e-c8da-4a94-88da-2c62d046f72a tempest-SnapshotDependencyTests-1172348225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.27abf13e-5519-4f6e-bde6-d3503509a4fc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:06 devstack sudo[101816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.27abf13e-5519-4f6e-bde6-d3503509a4fc Jul 06 15:41:06 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:07 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f99b081e-c8da-4a94-88da-2c62d046f72a tempest-SnapshotDependencyTests-1172348225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.27abf13e-5519-4f6e-bde6-d3503509a4fc" returned: 0 in 0.626s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f99b081e-c8da-4a94-88da-2c62d046f72a tempest-SnapshotDependencyTests-1172348225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:07 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.info Jul 06 15:41:07 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:07 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f99b081e-c8da-4a94-88da-2c62d046f72a tempest-SnapshotDependencyTests-1172348225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.info" returned: 0 in 0.655s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:07 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-f99b081e-c8da-4a94-88da-2c62d046f72a tempest-SnapshotDependencyTests-1172348225 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.info is being set with open permissions: ugo+rw Jul 06 15:41:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f99b081e-c8da-4a94-88da-2c62d046f72a tempest-SnapshotDependencyTests-1172348225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:07 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.info Jul 06 15:41:07 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:08 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f99b081e-c8da-4a94-88da-2c62d046f72a tempest-SnapshotDependencyTests-1172348225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.info" returned: 0 in 0.611s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f99b081e-c8da-4a94-88da-2c62d046f72a tempest-SnapshotDependencyTests-1172348225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.184s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.114s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:41:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2115834068',display_name='tempest-VolumesGetTest-Volume-1392211495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da00d5e3-5c1e-4938-ba22-b79a7a4247d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f28839379c014f2dbe5f049e4ed1981f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:05Z,use_quota=True,user_id='403e7e6d34d5466b917dfc9df3a9a19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:41:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Creating volume da00d5e3-5c1e-4938-ba22-b79a7a4247d8 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:41:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:41:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:41:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:41:08 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:41:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da00d5e3-5c1e-4938-ba22-b79a7a4247d8 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:08 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da00d5e3-5c1e-4938-ba22-b79a7a4247d8 1073741824 Jul 06 15:41:08 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:08 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-f99b081e-c8da-4a94-88da-2c62d046f72a tempest-SnapshotDependencyTests-1172348225 None] Create snapshot completed successfully Jul 06 15:41:09 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da00d5e3-5c1e-4938-ba22-b79a7a4247d8 1073741824" returned: 0 in 0.789s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da00d5e3-5c1e-4938-ba22-b79a7a4247d8 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:09 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da00d5e3-5c1e-4938-ba22-b79a7a4247d8 Jul 06 15:41:09 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:09 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da00d5e3-5c1e-4938-ba22-b79a7a4247d8" returned: 0 in 0.624s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:41:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604a7cb5-8206-4a43-8a21-e78ac108deea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da00d5e3-5c1e-4938-ba22-b79a7a4247d8', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b3188a-3496-4277-9d7b-96b5504ca014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:09 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Volume volume-da00d5e3-5c1e-4938-ba22-b79a7a4247d8 (da00d5e3-5c1e-4938-ba22-b79a7a4247d8): created successfully Jul 06 15:41:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b3188a-3496-4277-9d7b-96b5504ca014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Flow 'volume_create_manager' (669b9b79-a17d-43a8-83e0-31f056995f53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:41:10 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-73d6196a-a6b1-49e7-82b8-70149da2eaa3 tempest-VolumesGetTest-1561494887 None] Created volume successfully. Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Flow 'volume_create_manager' (d8f13175-f1fd-408c-b8b1-74f5fbbab8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5bd3773-374e-4974-9618-e3e2ca3e0b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5bd3773-374e-4974-9618-e3e2ca3e0b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a3e1588-4b38-4bd1-8127-756bfa89bb71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c39294b3ac4104882c85261edc75e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=27abf13e-5519-4f6e-bde6-d3503509a4fc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:10Z,use_quota=True,user_id='de42c12e4a864fc78854d0e21972a577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d47dc5b8-0e77-4a99-b8a5-3aa93699144e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d47dc5b8-0e77-4a99-b8a5-3aa93699144e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c697a7-e742-48e8-9f45-f763f7ec97a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c697a7-e742-48e8-9f45-f763f7ec97a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4a3e1588-4b38-4bd1-8127-756bfa89bb71', 'volume_name': 'volume-4a3e1588-4b38-4bd1-8127-756bfa89bb71', 'volume_size': 1, 'snapshot_id': '27abf13e-5519-4f6e-bde6-d3503509a4fc'}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc264b3e-d809-4b32-b5fe-1e0a0d3763a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc264b3e-d809-4b32-b5fe-1e0a0d3763a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1842859c-464d-431a-878d-a8ae5fd3b5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:10 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Volume 4a3e1588-4b38-4bd1-8127-756bfa89bb71: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4a3e1588-4b38-4bd1-8127-756bfa89bb71', 'volume_size': 1, 'snapshot_id': '27abf13e-5519-4f6e-bde6-d3503509a4fc'} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Acquiring lock "cinder-quobyte-27abf13e-5519-4f6e-bde6-d3503509a4fc-4a3e1588-4b38-4bd1-8127-756bfa89bb71" by "_create_volume_from_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Lock "cinder-quobyte-27abf13e-5519-4f6e-bde6-d3503509a4fc-4a3e1588-4b38-4bd1-8127-756bfa89bb71" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Creating volume 4a3e1588-4b38-4bd1-8127-756bfa89bb71 from snapshot 27abf13e-5519-4f6e-bde6-d3503509a4fc {{(pid=86148) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Acquiring lock "cinder-quobyte-4a3e1588-4b38-4bd1-8127-756bfa89bb71" by "_copy_volume_from_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Lock "cinder-quobyte-4a3e1588-4b38-4bd1-8127-756bfa89bb71" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] snapshot: 27abf13e-5519-4f6e-bde6-d3503509a4fc, volume: 4a3e1588-4b38-4bd1-8127-756bfa89bb71, {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aca4179-85fe-49a0-8182-0e773b30a8d6]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.27abf13e-5519-4f6e-bde6-d3503509a4fc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:10 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.27abf13e-5519-4f6e-bde6-d3503509a4fc Jul 06 15:41:10 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-387efd53-cee6-45ce-8fb0-eedf0e88ef27 tempest-VolumesGetTest-1561494887 None] Acquiring lock "cinder-da00d5e3-5c1e-4938-ba22-b79a7a4247d8-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-387efd53-cee6-45ce-8fb0-eedf0e88ef27 tempest-VolumesGetTest-1561494887 None] Lock "cinder-da00d5e3-5c1e-4938-ba22-b79a7a4247d8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-387efd53-cee6-45ce-8fb0-eedf0e88ef27 tempest-VolumesGetTest-1561494887 None] Acquiring lock "cinder-quobyte-da00d5e3-5c1e-4938-ba22-b79a7a4247d8" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-387efd53-cee6-45ce-8fb0-eedf0e88ef27 tempest-VolumesGetTest-1561494887 None] Lock "cinder-quobyte-da00d5e3-5c1e-4938-ba22-b79a7a4247d8" acquired by "delete_volume" :: waited 0.014s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[280da945-3753-4d7a-8ed2-cca3c1f72c6c]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-387efd53-cee6-45ce-8fb0-eedf0e88ef27 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da00d5e3-5c1e-4938-ba22-b79a7a4247d8 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:10 devstack sudo[101838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da00d5e3-5c1e-4938-ba22-b79a7a4247d8 Jul 06 15:41:10 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:11 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.27abf13e-5519-4f6e-bde6-d3503509a4fc" returned: 0 in 0.823s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:41:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6 {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 15:41:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Creating direct copy from snapshot {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 15:41:11 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc0600a-6579-4264-a8f0-bbd4590118d2]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:11 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6 Jul 06 15:41:11 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:11 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-387efd53-cee6-45ce-8fb0-eedf0e88ef27 tempest-VolumesGetTest-1561494887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da00d5e3-5c1e-4938-ba22-b79a7a4247d8" returned: 0 in 0.772s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-387efd53-cee6-45ce-8fb0-eedf0e88ef27 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da00d5e3-5c1e-4938-ba22-b79a7a4247d8 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:11 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da00d5e3-5c1e-4938-ba22-b79a7a4247d8 Jul 06 15:41:11 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:12 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6" returned: 0 in 0.764s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:12 devstack cinder-volume[86148]: DEBUG cinder.utils [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Path /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4a3e1588-4b38-4bd1-8127-756bfa89bb71 not found in is_blk_device check {{(pid=86148) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 15:41:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4a3e1588-4b38-4bd1-8127-756bfa89bb71 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:12 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4a3e1588-4b38-4bd1-8127-756bfa89bb71 Jul 06 15:41:12 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:12 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-387efd53-cee6-45ce-8fb0-eedf0e88ef27 tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-da00d5e3-5c1e-4938-ba22-b79a7a4247d8" returned: 0 in 0.697s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:12 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-387efd53-cee6-45ce-8fb0-eedf0e88ef27 tempest-VolumesGetTest-1561494887 None] Lock "cinder-quobyte-da00d5e3-5c1e-4938-ba22-b79a7a4247d8" released by "delete_volume" :: held 1.511s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:12 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-387efd53-cee6-45ce-8fb0-eedf0e88ef27 tempest-VolumesGetTest-1561494887 None] Created reservations ['68794b72-d2f7-449c-a970-e6538ba5a3dc', '8a59e956-abcc-409d-b583-b841b5b18497', '01171226-2526-4935-9359-5c92fe390538', '4438df83-eb82-48ea-b131-8863d3d1467d'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:41:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-387efd53-cee6-45ce-8fb0-eedf0e88ef27 tempest-VolumesGetTest-1561494887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-387efd53-cee6-45ce-8fb0-eedf0e88ef27 tempest-VolumesGetTest-1561494887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-387efd53-cee6-45ce-8fb0-eedf0e88ef27 tempest-VolumesGetTest-1561494887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:41:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-387efd53-cee6-45ce-8fb0-eedf0e88ef27 tempest-VolumesGetTest-1561494887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:41:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-387efd53-cee6-45ce-8fb0-eedf0e88ef27 tempest-VolumesGetTest-1561494887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-387efd53-cee6-45ce-8fb0-eedf0e88ef27 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:12 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:41:12 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:13 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-887541d8-4654-4dde-b99a-47780420eb12 tempest-VolumesGetTest-1561494887 None] Acquiring lock "cinder-e4210f00-56f0-4e9e-9858-1edc759d2f5d-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:13 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-887541d8-4654-4dde-b99a-47780420eb12 tempest-VolumesGetTest-1561494887 None] Lock "cinder-e4210f00-56f0-4e9e-9858-1edc759d2f5d-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:13 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-387efd53-cee6-45ce-8fb0-eedf0e88ef27 tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.948s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:13 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-387efd53-cee6-45ce-8fb0-eedf0e88ef27 tempest-VolumesGetTest-1561494887 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:41:13 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-387efd53-cee6-45ce-8fb0-eedf0e88ef27 tempest-VolumesGetTest-1561494887 None] Deleted volume successfully. Jul 06 15:41:13 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-387efd53-cee6-45ce-8fb0-eedf0e88ef27 tempest-VolumesGetTest-1561494887 None] Lock "cinder-da00d5e3-5c1e-4938-ba22-b79a7a4247d8-delete_volume" released by "delete_volume" :: held 2.810s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:13 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-887541d8-4654-4dde-b99a-47780420eb12 tempest-VolumesGetTest-1561494887 None] Acquiring lock "cinder-quobyte-e4210f00-56f0-4e9e-9858-1edc759d2f5d" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:13 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-887541d8-4654-4dde-b99a-47780420eb12 tempest-VolumesGetTest-1561494887 None] Lock "cinder-quobyte-e4210f00-56f0-4e9e-9858-1edc759d2f5d" acquired by "delete_volume" :: waited 0.026s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:13 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[5081ebfd-f660-40c4-b371-12cff83b6064]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-887541d8-4654-4dde-b99a-47780420eb12 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e4210f00-56f0-4e9e-9858-1edc759d2f5d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:13 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e4210f00-56f0-4e9e-9858-1edc759d2f5d Jul 06 15:41:13 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:15 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-887541d8-4654-4dde-b99a-47780420eb12 tempest-VolumesGetTest-1561494887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e4210f00-56f0-4e9e-9858-1edc759d2f5d" returned: 0 in 2.165s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-887541d8-4654-4dde-b99a-47780420eb12 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e4210f00-56f0-4e9e-9858-1edc759d2f5d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:15 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e4210f00-56f0-4e9e-9858-1edc759d2f5d Jul 06 15:41:15 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:16 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4a3e1588-4b38-4bd1-8127-756bfa89bb71" returned: 0 in 4.684s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:16 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[f249d94a-335d-4eda-860f-1e407e90541b]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:16 devstack sudo[101877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6 Jul 06 15:41:16 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:16 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-887541d8-4654-4dde-b99a-47780420eb12 tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e4210f00-56f0-4e9e-9858-1edc759d2f5d" returned: 0 in 1.126s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:16 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-887541d8-4654-4dde-b99a-47780420eb12 tempest-VolumesGetTest-1561494887 None] Lock "cinder-quobyte-e4210f00-56f0-4e9e-9858-1edc759d2f5d" released by "delete_volume" :: held 3.351s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:16 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-887541d8-4654-4dde-b99a-47780420eb12 tempest-VolumesGetTest-1561494887 None] Created reservations ['53ddd253-0622-492b-bafc-d98c9ccfb188', 'a0601473-1b4c-4f9b-a76a-8ea32c3fc1df', '0cf0bcad-8d7e-4f60-9cc3-bc26557124a7', '808cf54d-ba9a-4013-9d85-3b31d19c03bd'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:41:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-887541d8-4654-4dde-b99a-47780420eb12 tempest-VolumesGetTest-1561494887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-887541d8-4654-4dde-b99a-47780420eb12 tempest-VolumesGetTest-1561494887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:17 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-887541d8-4654-4dde-b99a-47780420eb12 tempest-VolumesGetTest-1561494887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:41:17 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-887541d8-4654-4dde-b99a-47780420eb12 tempest-VolumesGetTest-1561494887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:41:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-887541d8-4654-4dde-b99a-47780420eb12 tempest-VolumesGetTest-1561494887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-887541d8-4654-4dde-b99a-47780420eb12 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:17 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:41:17 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:17 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-887541d8-4654-4dde-b99a-47780420eb12 tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.654s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:17 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-887541d8-4654-4dde-b99a-47780420eb12 tempest-VolumesGetTest-1561494887 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:41:17 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-887541d8-4654-4dde-b99a-47780420eb12 tempest-VolumesGetTest-1561494887 None] Deleted volume successfully. Jul 06 15:41:17 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:17 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-887541d8-4654-4dde-b99a-47780420eb12 tempest-VolumesGetTest-1561494887 None] Lock "cinder-e4210f00-56f0-4e9e-9858-1edc759d2f5d-delete_volume" released by "delete_volume" :: held 4.357s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6" returned: 0 in 1.038s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:17 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6, size 1024.00 MB, duration 4.69 sec, destination /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4a3e1588-4b38-4bd1-8127-756bfa89bb71 {{(pid=86148) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:41:17 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Converted 1024.00 MB image at 218.54 MB/s Jul 06 15:41:17 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4a3e1588-4b38-4bd1-8127-756bfa89bb71 is being set with open permissions: ugo+rw Jul 06 15:41:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4a3e1588-4b38-4bd1-8127-756bfa89bb71 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:17 devstack sudo[101886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4a3e1588-4b38-4bd1-8127-756bfa89bb71 Jul 06 15:41:17 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:17 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-482cc04d-dc36-4142-bacc-549896f81082 tempest-VolumesGetTest-1561494887 None] Acquiring lock "cinder-f16ceb4c-3408-476a-b9c6-7c8e98b1e705-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:18 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-482cc04d-dc36-4142-bacc-549896f81082 tempest-VolumesGetTest-1561494887 None] Lock "cinder-f16ceb4c-3408-476a-b9c6-7c8e98b1e705-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:18 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-482cc04d-dc36-4142-bacc-549896f81082 tempest-VolumesGetTest-1561494887 None] Acquiring lock "cinder-quobyte-f16ceb4c-3408-476a-b9c6-7c8e98b1e705" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:18 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-482cc04d-dc36-4142-bacc-549896f81082 tempest-VolumesGetTest-1561494887 None] Lock "cinder-quobyte-f16ceb4c-3408-476a-b9c6-7c8e98b1e705" acquired by "delete_volume" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:18 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d16629-291f-46d6-a5e2-2827bf2c176f]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-482cc04d-dc36-4142-bacc-549896f81082 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:18 devstack sudo[101888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705 Jul 06 15:41:18 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:18 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4a3e1588-4b38-4bd1-8127-756bfa89bb71" returned: 0 in 0.643s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:18 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Lock "cinder-quobyte-4a3e1588-4b38-4bd1-8127-756bfa89bb71" released by "_copy_volume_from_snapshot" :: held 8.042s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:18 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Lock "cinder-quobyte-27abf13e-5519-4f6e-bde6-d3503509a4fc-4a3e1588-4b38-4bd1-8127-756bfa89bb71" released by "_create_volume_from_snapshot" :: held 8.074s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.088s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:18 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1842859c-464d-431a-878d-a8ae5fd3b5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a3e1588-4b38-4bd1-8127-756bfa89bb71', 'volume_size': 1, 'snapshot_id': '27abf13e-5519-4f6e-bde6-d3503509a4fc'}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:18 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29617e48-8fe9-4d81-a059-1d87a5af4eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:18 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Volume volume-4a3e1588-4b38-4bd1-8127-756bfa89bb71 (4a3e1588-4b38-4bd1-8127-756bfa89bb71): created successfully Jul 06 15:41:18 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29617e48-8fe9-4d81-a059-1d87a5af4eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:18 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Flow 'volume_create_manager' (d8f13175-f1fd-408c-b8b1-74f5fbbab8b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:41:18 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-5c801700-c1b7-4e16-8a95-3b52b50d7f0e tempest-SnapshotDependencyTests-1172348225 None] Created volume successfully. Jul 06 15:41:18 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-482cc04d-dc36-4142-bacc-549896f81082 tempest-VolumesGetTest-1561494887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705" returned: 0 in 0.795s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-482cc04d-dc36-4142-bacc-549896f81082 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:18 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705 Jul 06 15:41:18 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c7ddf243-5ffe-4edb-acc3-84203beebc94 tempest-SnapshotDependencyTests-1172348225 None] Acquiring lock "cinder-27abf13e-5519-4f6e-bde6-d3503509a4fc-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c7ddf243-5ffe-4edb-acc3-84203beebc94 tempest-SnapshotDependencyTests-1172348225 None] Lock "cinder-27abf13e-5519-4f6e-bde6-d3503509a4fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c7ddf243-5ffe-4edb-acc3-84203beebc94 tempest-SnapshotDependencyTests-1172348225 None] Acquiring lock "cinder-quobyte-ee62bfd2-a6cf-42bd-a699-6ccb515072f6" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c7ddf243-5ffe-4edb-acc3-84203beebc94 tempest-SnapshotDependencyTests-1172348225 None] Lock "cinder-quobyte-ee62bfd2-a6cf-42bd-a699-6ccb515072f6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c7ddf243-5ffe-4edb-acc3-84203beebc94 tempest-SnapshotDependencyTests-1172348225 None] Acquiring lock "cinder-quobyte-27abf13e-5519-4f6e-bde6-d3503509a4fc" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c7ddf243-5ffe-4edb-acc3-84203beebc94 tempest-SnapshotDependencyTests-1172348225 None] Lock "cinder-quobyte-27abf13e-5519-4f6e-bde6-d3503509a4fc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:19 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-c7ddf243-5ffe-4edb-acc3-84203beebc94 tempest-SnapshotDependencyTests-1172348225 None] Deleting offline snapshot 27abf13e-5519-4f6e-bde6-d3503509a4fc of volume ee62bfd2-a6cf-42bd-a699-6ccb515072f6 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:41:19 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-c7ddf243-5ffe-4edb-acc3-84203beebc94 tempest-SnapshotDependencyTests-1172348225 None] snapshot_file for this snap is: volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.27abf13e-5519-4f6e-bde6-d3503509a4fc {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:41:19 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66e0540-f70e-4d76-9eb3-affc261803a4]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c7ddf243-5ffe-4edb-acc3-84203beebc94 tempest-SnapshotDependencyTests-1172348225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.27abf13e-5519-4f6e-bde6-d3503509a4fc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:19 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.27abf13e-5519-4f6e-bde6-d3503509a4fc Jul 06 15:41:19 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:19 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-482cc04d-dc36-4142-bacc-549896f81082 tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f16ceb4c-3408-476a-b9c6-7c8e98b1e705" returned: 0 in 0.742s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-482cc04d-dc36-4142-bacc-549896f81082 tempest-VolumesGetTest-1561494887 None] Lock "cinder-quobyte-f16ceb4c-3408-476a-b9c6-7c8e98b1e705" released by "delete_volume" :: held 1.609s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:19 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-482cc04d-dc36-4142-bacc-549896f81082 tempest-VolumesGetTest-1561494887 None] Created reservations ['a3226115-7a20-4034-9b42-92865470e174', '6ecf500a-6322-460e-9055-cc304e66fd84', 'c0f7d8ee-28b3-4188-92c1-53f14217b5ca', 'adbd4f78-9310-4122-a100-51a25b5cb0bb'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:41:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-482cc04d-dc36-4142-bacc-549896f81082 tempest-VolumesGetTest-1561494887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-482cc04d-dc36-4142-bacc-549896f81082 tempest-VolumesGetTest-1561494887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:19 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-482cc04d-dc36-4142-bacc-549896f81082 tempest-VolumesGetTest-1561494887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:41:19 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-482cc04d-dc36-4142-bacc-549896f81082 tempest-VolumesGetTest-1561494887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:41:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-482cc04d-dc36-4142-bacc-549896f81082 tempest-VolumesGetTest-1561494887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-482cc04d-dc36-4142-bacc-549896f81082 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:19 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:41:19 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:19 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c7ddf243-5ffe-4edb-acc3-84203beebc94 tempest-SnapshotDependencyTests-1172348225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.27abf13e-5519-4f6e-bde6-d3503509a4fc" returned: 0 in 0.762s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:19 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-c7ddf243-5ffe-4edb-acc3-84203beebc94 tempest-SnapshotDependencyTests-1172348225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:41:19 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e043ae-a42c-4103-a3b0-873d89513b77]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c7ddf243-5ffe-4edb-acc3-84203beebc94 tempest-SnapshotDependencyTests-1172348225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:20 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6 Jul 06 15:41:20 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:20 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-482cc04d-dc36-4142-bacc-549896f81082 tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.689s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:20 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-482cc04d-dc36-4142-bacc-549896f81082 tempest-VolumesGetTest-1561494887 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:41:20 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-482cc04d-dc36-4142-bacc-549896f81082 tempest-VolumesGetTest-1561494887 None] Deleted volume successfully. Jul 06 15:41:20 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-482cc04d-dc36-4142-bacc-549896f81082 tempest-VolumesGetTest-1561494887 None] Lock "cinder-f16ceb4c-3408-476a-b9c6-7c8e98b1e705-delete_volume" released by "delete_volume" :: held 2.542s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:20 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c7ddf243-5ffe-4edb-acc3-84203beebc94 tempest-SnapshotDependencyTests-1172348225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6" returned: 0 in 0.902s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c7ddf243-5ffe-4edb-acc3-84203beebc94 tempest-SnapshotDependencyTests-1172348225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.27abf13e-5519-4f6e-bde6-d3503509a4fc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:20 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.27abf13e-5519-4f6e-bde6-d3503509a4fc Jul 06 15:41:20 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:20 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:41:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Flow 'volume_create_manager' (8d65eb6d-763b-41ba-ac95-cd43e8714d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:41:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d3f0da9-4b8b-491c-9077-a23a3937a5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d3f0da9-4b8b-491c-9077-a23a3937a5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1304607406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=700ddab8-f1fc-4bef-b221-fd98a804000f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f28839379c014f2dbe5f049e4ed1981f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:21Z,use_quota=True,user_id='403e7e6d34d5466b917dfc9df3a9a19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a74d209-55d3-4008-a94f-6381bcf0e84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a74d209-55d3-4008-a94f-6381bcf0e84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3345cb2e-1061-48fd-a81e-b1c3537eae39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:21 devstack cinder-volume[86148]: DEBUG cinder.image.glance [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Creating Keystone auth plugin from conf {{(pid=86148) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 15:41:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3345cb2e-1061-48fd-a81e-b1c3537eae39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '700ddab8-f1fc-4bef-b221-fd98a804000f', 'volume_name': 'volume-700ddab8-f1fc-4bef-b221-fd98a804000f', 'volume_size': 1, 'image_id': 'aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2cea8b96599e40e1978f302796eb3239', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'created_at': datetime.datetime(2026, 7, 6, 13, 18, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 18, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432d4cd7-3a13-4954-ae7c-2b264d9cfea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432d4cd7-3a13-4954-ae7c-2b264d9cfea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa42347-9194-4958-84bd-fbba207d1c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:21 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Volume 700ddab8-f1fc-4bef-b221-fd98a804000f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-700ddab8-f1fc-4bef-b221-fd98a804000f', 'volume_size': 1, 'image_id': 'aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2cea8b96599e40e1978f302796eb3239', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'created_at': datetime.datetime(2026, 7, 6, 13, 18, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 18, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 15:41:21 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Trying to clone 700ddab8-f1fc-4bef-b221-fd98a804000f from image aab1d6f3-bc8c-4137-9f0e-54346f68c452 at location (None, [{'url': 'file:///opt/stack/data/glance/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'metadata': {}}]). {{(pid=86148) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 15:41:21 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_qddxo7dodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86148) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 15:41:21 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Image download 20.69 MB at 20.69 MB/s Jul 06 15:41:21 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c7ddf243-5ffe-4edb-acc3-84203beebc94 tempest-SnapshotDependencyTests-1172348225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.27abf13e-5519-4f6e-bde6-d3503509a4fc" returned: 0 in 0.928s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c7ddf243-5ffe-4edb-acc3-84203beebc94 tempest-SnapshotDependencyTests-1172348225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.27abf13e-5519-4f6e-bde6-d3503509a4fc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:21 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2442b4-8cb3-4555-8770-2a87a75f4ba5]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_qddxo7dodevstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:21 devstack sudo[101917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.27abf13e-5519-4f6e-bde6-d3503509a4fc Jul 06 15:41:21 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:21 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_qddxo7dodevstack@QuobyteHD Jul 06 15:41:21 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:22 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c7ddf243-5ffe-4edb-acc3-84203beebc94 tempest-SnapshotDependencyTests-1172348225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6.27abf13e-5519-4f6e-bde6-d3503509a4fc" returned: 0 in 0.647s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:22 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c7ddf243-5ffe-4edb-acc3-84203beebc94 tempest-SnapshotDependencyTests-1172348225 None] Lock "cinder-quobyte-27abf13e-5519-4f6e-bde6-d3503509a4fc" released by "_delete_snapshot" :: held 3.336s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:22 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c7ddf243-5ffe-4edb-acc3-84203beebc94 tempest-SnapshotDependencyTests-1172348225 None] Lock "cinder-quobyte-ee62bfd2-a6cf-42bd-a699-6ccb515072f6" released by "delete_snapshot" :: held 3.358s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:22 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-c7ddf243-5ffe-4edb-acc3-84203beebc94 tempest-SnapshotDependencyTests-1172348225 None] Created reservations ['eea11af9-b7e2-4a8b-802f-d720081a7703', 'ae2b5895-02b2-404c-b3d1-1361dd1589d9', '5305eb1d-d98b-409f-bb17-3ab7b1ca6a65', '1f07857f-11c1-49bf-9dda-396b3ef2a050'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:41:22 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_qddxo7dodevstack@QuobyteHD" returned: 0 in 0.744s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:22 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Temporary image aab1d6f3-bc8c-4137-9f0e-54346f68c452 is fetched for user 403e7e6d34d5466b917dfc9df3a9a19f. {{(pid=86148) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 15:41:22 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-c7ddf243-5ffe-4edb-acc3-84203beebc94 tempest-SnapshotDependencyTests-1172348225 None] Delete snapshot completed successfully. Jul 06 15:41:22 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c7ddf243-5ffe-4edb-acc3-84203beebc94 tempest-SnapshotDependencyTests-1172348225 None] Lock "cinder-27abf13e-5519-4f6e-bde6-d3503509a4fc-delete_snapshot" released by "delete_snapshot" :: held 3.517s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:22 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c02237-d864-40d3-84f8-edf399d2f83a]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_qddxo7dodevstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:22 devstack sudo[101925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_qddxo7dodevstack@QuobyteHD Jul 06 15:41:22 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-7cc28cae-b194-4f0b-8df4-376612fccd71 tempest-SnapshotDependencyTests-1172348225 None] Acquiring lock "cinder-ee62bfd2-a6cf-42bd-a699-6ccb515072f6-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:23 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_qddxo7dodevstack@QuobyteHD" returned: 0 in 0.715s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1304607406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=700ddab8-f1fc-4bef-b221-fd98a804000f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f28839379c014f2dbe5f049e4ed1981f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:21Z,use_quota=True,user_id='403e7e6d34d5466b917dfc9df3a9a19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:41:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Creating volume 700ddab8-f1fc-4bef-b221-fd98a804000f {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:41:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:41:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:41:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:41:23 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:41:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-7cc28cae-b194-4f0b-8df4-376612fccd71 tempest-SnapshotDependencyTests-1172348225 None] Lock "cinder-ee62bfd2-a6cf-42bd-a699-6ccb515072f6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:23 devstack sudo[101930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f 1073741824 Jul 06 15:41:23 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-7cc28cae-b194-4f0b-8df4-376612fccd71 tempest-SnapshotDependencyTests-1172348225 None] Acquiring lock "cinder-quobyte-ee62bfd2-a6cf-42bd-a699-6ccb515072f6" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-7cc28cae-b194-4f0b-8df4-376612fccd71 tempest-SnapshotDependencyTests-1172348225 None] Lock "cinder-quobyte-ee62bfd2-a6cf-42bd-a699-6ccb515072f6" acquired by "delete_volume" :: waited 0.014s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:23 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fdf594-ed94-4f35-bbe4-68aa1b18b3a1]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7cc28cae-b194-4f0b-8df4-376612fccd71 tempest-SnapshotDependencyTests-1172348225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:23 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6 Jul 06 15:41:23 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:24 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7cc28cae-b194-4f0b-8df4-376612fccd71 tempest-SnapshotDependencyTests-1172348225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6" returned: 0 in 0.767s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7cc28cae-b194-4f0b-8df4-376612fccd71 tempest-SnapshotDependencyTests-1172348225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:24 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6 Jul 06 15:41:24 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:24 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f 1073741824" returned: 0 in 0.915s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:24 devstack sudo[101943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f Jul 06 15:41:24 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:24 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7cc28cae-b194-4f0b-8df4-376612fccd71 tempest-SnapshotDependencyTests-1172348225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ee62bfd2-a6cf-42bd-a699-6ccb515072f6" returned: 0 in 0.667s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:24 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-7cc28cae-b194-4f0b-8df4-376612fccd71 tempest-SnapshotDependencyTests-1172348225 None] Lock "cinder-quobyte-ee62bfd2-a6cf-42bd-a699-6ccb515072f6" released by "delete_volume" :: held 1.499s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:24 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f" returned: 0 in 0.652s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:41:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:25 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-7cc28cae-b194-4f0b-8df4-376612fccd71 tempest-SnapshotDependencyTests-1172348225 None] Created reservations ['ff943e46-f31a-4c94-bc03-ce9a52879b04', '4102d0d9-563d-4d5f-8d30-e7da4b63606f', 'f7158385-5cc0-43c9-9a00-7428cb9edbc1', '9aeaf728-93db-4e49-8284-eaa7f47f1e32'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:41:25 devstack cinder-volume[86148]: DEBUG cinder.volume.volume_utils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Attempting download of aab1d6f3-bc8c-4137-9f0e-54346f68c452 ((None, [{'url': 'file:///opt/stack/data/glance/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'metadata': {}}])) to volume 700ddab8-f1fc-4bef-b221-fd98a804000f. {{(pid=86148) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 15:41:25 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2892cfd-ce97-409a-b8c7-49fe2fb042fe]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aab1d6f3-bc8c-4137-9f0e-54346f68c452_lj71b70j {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7cc28cae-b194-4f0b-8df4-376612fccd71 tempest-SnapshotDependencyTests-1172348225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7cc28cae-b194-4f0b-8df4-376612fccd71 tempest-SnapshotDependencyTests-1172348225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:25 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-7cc28cae-b194-4f0b-8df4-376612fccd71 tempest-SnapshotDependencyTests-1172348225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:41:25 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-7cc28cae-b194-4f0b-8df4-376612fccd71 tempest-SnapshotDependencyTests-1172348225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:41:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7cc28cae-b194-4f0b-8df4-376612fccd71 tempest-SnapshotDependencyTests-1172348225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7cc28cae-b194-4f0b-8df4-376612fccd71 tempest-SnapshotDependencyTests-1172348225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:25 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:41:25 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:25 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aab1d6f3-bc8c-4137-9f0e-54346f68c452_lj71b70j Jul 06 15:41:25 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:25 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6a69322b-245f-44b3-9880-bf62f0da2ef8 tempest-SnapshotDependencyTests-1172348225 None] Acquiring lock "cinder-4a3e1588-4b38-4bd1-8127-756bfa89bb71-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:25 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6a69322b-245f-44b3-9880-bf62f0da2ef8 tempest-SnapshotDependencyTests-1172348225 None] Lock "cinder-4a3e1588-4b38-4bd1-8127-756bfa89bb71-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:25 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6a69322b-245f-44b3-9880-bf62f0da2ef8 tempest-SnapshotDependencyTests-1172348225 None] Acquiring lock "cinder-quobyte-4a3e1588-4b38-4bd1-8127-756bfa89bb71" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:25 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6a69322b-245f-44b3-9880-bf62f0da2ef8 tempest-SnapshotDependencyTests-1172348225 None] Lock "cinder-quobyte-4a3e1588-4b38-4bd1-8127-756bfa89bb71" acquired by "delete_volume" :: waited 0.021s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:25 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecf17ef-0149-4236-b2bb-c8f6b049a44d]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6a69322b-245f-44b3-9880-bf62f0da2ef8 tempest-SnapshotDependencyTests-1172348225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4a3e1588-4b38-4bd1-8127-756bfa89bb71 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:25 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7cc28cae-b194-4f0b-8df4-376612fccd71 tempest-SnapshotDependencyTests-1172348225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.692s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:25 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-7cc28cae-b194-4f0b-8df4-376612fccd71 tempest-SnapshotDependencyTests-1172348225 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:41:25 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-7cc28cae-b194-4f0b-8df4-376612fccd71 tempest-SnapshotDependencyTests-1172348225 None] Deleted volume successfully. Jul 06 15:41:25 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-7cc28cae-b194-4f0b-8df4-376612fccd71 tempest-SnapshotDependencyTests-1172348225 None] Lock "cinder-ee62bfd2-a6cf-42bd-a699-6ccb515072f6-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:25 devstack sudo[101953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4a3e1588-4b38-4bd1-8127-756bfa89bb71 Jul 06 15:41:25 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:25 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aab1d6f3-bc8c-4137-9f0e-54346f68c452_lj71b70j" returned: 0 in 0.803s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aab1d6f3-bc8c-4137-9f0e-54346f68c452_lj71b70j {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:25 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aab1d6f3-bc8c-4137-9f0e-54346f68c452_lj71b70j Jul 06 15:41:25 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:26 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6a69322b-245f-44b3-9880-bf62f0da2ef8 tempest-SnapshotDependencyTests-1172348225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4a3e1588-4b38-4bd1-8127-756bfa89bb71" returned: 0 in 0.798s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6a69322b-245f-44b3-9880-bf62f0da2ef8 tempest-SnapshotDependencyTests-1172348225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4a3e1588-4b38-4bd1-8127-756bfa89bb71 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:26 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4a3e1588-4b38-4bd1-8127-756bfa89bb71 Jul 06 15:41:26 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:26 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aab1d6f3-bc8c-4137-9f0e-54346f68c452_lj71b70j" returned: 1 in 0.778s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aab1d6f3-bc8c-4137-9f0e-54346f68c452_lj71b70j' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:41:26 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[c179ec1f-576b-401f-853a-f3d0e1b2b10c]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_qddxo7dodevstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:26 devstack sudo[101965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_qddxo7dodevstack@QuobyteHD Jul 06 15:41:26 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:27 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6a69322b-245f-44b3-9880-bf62f0da2ef8 tempest-SnapshotDependencyTests-1172348225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-4a3e1588-4b38-4bd1-8127-756bfa89bb71" returned: 0 in 0.716s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:27 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6a69322b-245f-44b3-9880-bf62f0da2ef8 tempest-SnapshotDependencyTests-1172348225 None] Lock "cinder-quobyte-4a3e1588-4b38-4bd1-8127-756bfa89bb71" released by "delete_volume" :: held 1.561s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:27 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-6a69322b-245f-44b3-9880-bf62f0da2ef8 tempest-SnapshotDependencyTests-1172348225 None] Created reservations ['d73ea76b-c261-4ddd-8596-0afd1bea586e', 'a67f3843-dea7-484f-829d-062b613618fb', 'ba4ad694-8680-4148-8ebd-0f0bfb83bf85', 'e530af49-bef3-44da-b306-0c99a339b8a8'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:41:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6a69322b-245f-44b3-9880-bf62f0da2ef8 tempest-SnapshotDependencyTests-1172348225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6a69322b-245f-44b3-9880-bf62f0da2ef8 tempest-SnapshotDependencyTests-1172348225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:27 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6a69322b-245f-44b3-9880-bf62f0da2ef8 tempest-SnapshotDependencyTests-1172348225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:41:27 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6a69322b-245f-44b3-9880-bf62f0da2ef8 tempest-SnapshotDependencyTests-1172348225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:41:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6a69322b-245f-44b3-9880-bf62f0da2ef8 tempest-SnapshotDependencyTests-1172348225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6a69322b-245f-44b3-9880-bf62f0da2ef8 tempest-SnapshotDependencyTests-1172348225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:27 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_qddxo7dodevstack@QuobyteHD" returned: 0 in 0.734s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:27 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] aab1d6f3-bc8c-4137-9f0e-54346f68c452 was qcow2, converting to raw {{(pid=86148) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 15:41:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_qddxo7dodevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:27 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:41:27 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:27 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_qddxo7dodevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f Jul 06 15:41:27 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:28 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6a69322b-245f-44b3-9880-bf62f0da2ef8 tempest-SnapshotDependencyTests-1172348225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.678s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:28 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-6a69322b-245f-44b3-9880-bf62f0da2ef8 tempest-SnapshotDependencyTests-1172348225 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:41:28 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-6a69322b-245f-44b3-9880-bf62f0da2ef8 tempest-SnapshotDependencyTests-1172348225 None] Deleted volume successfully. Jul 06 15:41:28 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6a69322b-245f-44b3-9880-bf62f0da2ef8 tempest-SnapshotDependencyTests-1172348225 None] Lock "cinder-4a3e1588-4b38-4bd1-8127-756bfa89bb71-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:29 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_qddxo7dodevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f" returned: 0 in 1.999s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:29 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_qddxo7dodevstack@QuobyteHD, size 112.00 MB, duration 2.00 sec, destination /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f {{(pid=86148) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:41:29 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Converted 112.00 MB image at 56.01 MB/s Jul 06 15:41:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:29 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f 1G Jul 06 15:41:29 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:30 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f 1G" returned: 0 in 0.760s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:30 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[7402a4dc-5759-4d72-8375-af07a82a130e]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:30 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f Jul 06 15:41:30 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:30 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f" returned: 0 in 0.748s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:31 devstack sudo[101996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f Jul 06 15:41:31 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:31 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f" returned: 1 in 0.867s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:41:31 devstack cinder-volume[86148]: DEBUG cinder.volume.volume_utils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Downloaded image aab1d6f3-bc8c-4137-9f0e-54346f68c452 ((None, [{'url': 'file:///opt/stack/data/glance/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'metadata': {}}])) to volume 700ddab8-f1fc-4bef-b221-fd98a804000f successfully. {{(pid=86148) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 15:41:31 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Temporary image aab1d6f3-bc8c-4137-9f0e-54346f68c452 for user 403e7e6d34d5466b917dfc9df3a9a19f is deleted. {{(pid=86148) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 15:41:31 devstack cinder-volume[86148]: DEBUG cinder.volume.volume_utils [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Marking volume 700ddab8-f1fc-4bef-b221-fd98a804000f as bootable. {{(pid=86148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 15:41:31 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Copying metadata from image aab1d6f3-bc8c-4137-9f0e-54346f68c452 to 700ddab8-f1fc-4bef-b221-fd98a804000f. {{(pid=86148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 15:41:31 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Creating volume glance metadata for volume 700ddab8-f1fc-4bef-b221-fd98a804000f backed by image aab1d6f3-bc8c-4137-9f0e-54346f68c452 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86148) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 15:41:31 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa42347-9194-4958-84bd-fbba207d1c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-700ddab8-f1fc-4bef-b221-fd98a804000f', 'volume_size': 1, 'image_id': 'aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2cea8b96599e40e1978f302796eb3239', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'created_at': datetime.datetime(2026, 7, 6, 13, 18, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 18, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:31 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75c35ccb-d32c-4cdc-9a22-b61db0754e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:31 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Volume volume-700ddab8-f1fc-4bef-b221-fd98a804000f (700ddab8-f1fc-4bef-b221-fd98a804000f): created successfully Jul 06 15:41:31 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75c35ccb-d32c-4cdc-9a22-b61db0754e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:31 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Flow 'volume_create_manager' (8d65eb6d-763b-41ba-ac95-cd43e8714d57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:41:31 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-0a61c0b5-22bc-4694-8ac4-f2b7d2992c51 tempest-VolumesGetTest-1561494887 None] Created volume successfully. Jul 06 15:41:33 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:41:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Flow 'volume_create_manager' (7884d1e5-5132-4f28-aa74-cd04d20719ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:41:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec2d147-6917-453a-8514-6b9adedbeab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec2d147-6917-453a-8514-6b9adedbeab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:41:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-625968589',display_name='tempest-VolumesGetTest-Volume-1192645565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e41490-7dbf-4f94-b7ee-f23c87f466aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f28839379c014f2dbe5f049e4ed1981f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:33Z,use_quota=True,user_id='403e7e6d34d5466b917dfc9df3a9a19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e1afa8-b68c-4eae-976f-80319eaea5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e1afa8-b68c-4eae-976f-80319eaea5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4fd6bc4-3239-4ca3-9c68-2687da9d835e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4fd6bc4-3239-4ca3-9c68-2687da9d835e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24e41490-7dbf-4f94-b7ee-f23c87f466aa', 'volume_name': 'volume-24e41490-7dbf-4f94-b7ee-f23c87f466aa', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a21a235-640f-4682-8765-f5078f752a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a21a235-640f-4682-8765-f5078f752a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09fea5c1-614b-4e01-aa21-974b4f30a144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:33 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Volume 24e41490-7dbf-4f94-b7ee-f23c87f466aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24e41490-7dbf-4f94-b7ee-f23c87f466aa', 'volume_size': 1} Jul 06 15:41:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:41:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-625968589',display_name='tempest-VolumesGetTest-Volume-1192645565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e41490-7dbf-4f94-b7ee-f23c87f466aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f28839379c014f2dbe5f049e4ed1981f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:33Z,use_quota=True,user_id='403e7e6d34d5466b917dfc9df3a9a19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:41:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Creating volume 24e41490-7dbf-4f94-b7ee-f23c87f466aa {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:41:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:41:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:41:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:41:33 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:41:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e41490-7dbf-4f94-b7ee-f23c87f466aa 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:33 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e41490-7dbf-4f94-b7ee-f23c87f466aa 1073741824 Jul 06 15:41:33 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:34 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e41490-7dbf-4f94-b7ee-f23c87f466aa 1073741824" returned: 0 in 0.898s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e41490-7dbf-4f94-b7ee-f23c87f466aa {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:34 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e41490-7dbf-4f94-b7ee-f23c87f466aa Jul 06 15:41:34 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:35 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e41490-7dbf-4f94-b7ee-f23c87f466aa" returned: 0 in 0.723s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:35 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:41:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09fea5c1-614b-4e01-aa21-974b4f30a144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24e41490-7dbf-4f94-b7ee-f23c87f466aa', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b083789-b942-4c01-9462-2e60f950fdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:35 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Volume volume-24e41490-7dbf-4f94-b7ee-f23c87f466aa (24e41490-7dbf-4f94-b7ee-f23c87f466aa): created successfully Jul 06 15:41:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b083789-b942-4c01-9462-2e60f950fdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Flow 'volume_create_manager' (7884d1e5-5132-4f28-aa74-cd04d20719ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:41:35 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a165bc74-04a6-4d47-b1b8-c65c6336e4b5 tempest-VolumesGetTest-1561494887 None] Created volume successfully. Jul 06 15:41:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e1301fc4-7556-48f3-98f6-a0ad45c4b9cd tempest-VolumesGetTest-1561494887 None] Acquiring lock "cinder-24e41490-7dbf-4f94-b7ee-f23c87f466aa-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e1301fc4-7556-48f3-98f6-a0ad45c4b9cd tempest-VolumesGetTest-1561494887 None] Lock "cinder-24e41490-7dbf-4f94-b7ee-f23c87f466aa-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e1301fc4-7556-48f3-98f6-a0ad45c4b9cd tempest-VolumesGetTest-1561494887 None] Acquiring lock "cinder-quobyte-24e41490-7dbf-4f94-b7ee-f23c87f466aa" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e1301fc4-7556-48f3-98f6-a0ad45c4b9cd tempest-VolumesGetTest-1561494887 None] Lock "cinder-quobyte-24e41490-7dbf-4f94-b7ee-f23c87f466aa" acquired by "delete_volume" :: waited 0.023s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:35 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c0abf7-2826-4dad-b4ff-04f313580c05]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e1301fc4-7556-48f3-98f6-a0ad45c4b9cd tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e41490-7dbf-4f94-b7ee-f23c87f466aa {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:35 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e41490-7dbf-4f94-b7ee-f23c87f466aa Jul 06 15:41:35 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:36 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e1301fc4-7556-48f3-98f6-a0ad45c4b9cd tempest-VolumesGetTest-1561494887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e41490-7dbf-4f94-b7ee-f23c87f466aa" returned: 0 in 0.783s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e1301fc4-7556-48f3-98f6-a0ad45c4b9cd tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e41490-7dbf-4f94-b7ee-f23c87f466aa {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:36 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e41490-7dbf-4f94-b7ee-f23c87f466aa Jul 06 15:41:36 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:37 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e1301fc4-7556-48f3-98f6-a0ad45c4b9cd tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-24e41490-7dbf-4f94-b7ee-f23c87f466aa" returned: 0 in 0.660s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:37 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e1301fc4-7556-48f3-98f6-a0ad45c4b9cd tempest-VolumesGetTest-1561494887 None] Lock "cinder-quobyte-24e41490-7dbf-4f94-b7ee-f23c87f466aa" released by "delete_volume" :: held 1.497s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:37 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:UPDATE=98,cinder:SELECT=79,cinder:INSERT=23,cinder:DELETE=10 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:41:37 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-e1301fc4-7556-48f3-98f6-a0ad45c4b9cd tempest-VolumesGetTest-1561494887 None] Created reservations ['bad6ca27-c8bd-4ea1-84ec-22ea7dd334e4', 'dea0eaa7-d0ab-42eb-9781-434c277bda82', 'db0c85cb-ed8b-4785-b74c-172c7454aa20', '9628368b-88b2-4b64-971c-ed3017619d03'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:41:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e1301fc4-7556-48f3-98f6-a0ad45c4b9cd tempest-VolumesGetTest-1561494887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e1301fc4-7556-48f3-98f6-a0ad45c4b9cd tempest-VolumesGetTest-1561494887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e1301fc4-7556-48f3-98f6-a0ad45c4b9cd tempest-VolumesGetTest-1561494887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:41:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e1301fc4-7556-48f3-98f6-a0ad45c4b9cd tempest-VolumesGetTest-1561494887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:41:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e1301fc4-7556-48f3-98f6-a0ad45c4b9cd tempest-VolumesGetTest-1561494887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e1301fc4-7556-48f3-98f6-a0ad45c4b9cd tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:37 devstack sudo[102026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:41:37 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-579cd6f8-0d76-4fb3-b9dd-7c316d2a3b41 tempest-VolumesGetTest-1561494887 None] Acquiring lock "cinder-700ddab8-f1fc-4bef-b221-fd98a804000f-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-579cd6f8-0d76-4fb3-b9dd-7c316d2a3b41 tempest-VolumesGetTest-1561494887 None] Lock "cinder-700ddab8-f1fc-4bef-b221-fd98a804000f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-579cd6f8-0d76-4fb3-b9dd-7c316d2a3b41 tempest-VolumesGetTest-1561494887 None] Acquiring lock "cinder-quobyte-700ddab8-f1fc-4bef-b221-fd98a804000f" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:38 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e1301fc4-7556-48f3-98f6-a0ad45c4b9cd tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.708s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:38 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-e1301fc4-7556-48f3-98f6-a0ad45c4b9cd tempest-VolumesGetTest-1561494887 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:41:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-579cd6f8-0d76-4fb3-b9dd-7c316d2a3b41 tempest-VolumesGetTest-1561494887 None] Lock "cinder-quobyte-700ddab8-f1fc-4bef-b221-fd98a804000f" acquired by "delete_volume" :: waited 0.030s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:38 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-e1301fc4-7556-48f3-98f6-a0ad45c4b9cd tempest-VolumesGetTest-1561494887 None] Deleted volume successfully. Jul 06 15:41:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e1301fc4-7556-48f3-98f6-a0ad45c4b9cd tempest-VolumesGetTest-1561494887 None] Lock "cinder-24e41490-7dbf-4f94-b7ee-f23c87f466aa-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:38 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d76317e-122f-4b60-a7c7-9c324246f50b]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-579cd6f8-0d76-4fb3-b9dd-7c316d2a3b41 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:38 devstack sudo[102029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f Jul 06 15:41:38 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:41:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:41:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:41:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:38 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:41:38 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:39 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-579cd6f8-0d76-4fb3-b9dd-7c316d2a3b41 tempest-VolumesGetTest-1561494887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f" returned: 0 in 0.787s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-579cd6f8-0d76-4fb3-b9dd-7c316d2a3b41 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:39 devstack sudo[102036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f Jul 06 15:41:39 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:39 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.746s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:41:39 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager._thread_info {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:41:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread count: 28 {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:41:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread info: [<_MainThread(MainThread, started 124857273856128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:41:39 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-579cd6f8-0d76-4fb3-b9dd-7c316d2a3b41 tempest-VolumesGetTest-1561494887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f" returned: 1 in 0.736s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-579cd6f8-0d76-4fb3-b9dd-7c316d2a3b41 tempest-VolumesGetTest-1561494887 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:41:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-579cd6f8-0d76-4fb3-b9dd-7c316d2a3b41 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:39 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f Jul 06 15:41:39 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:40 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-579cd6f8-0d76-4fb3-b9dd-7c316d2a3b41 tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-700ddab8-f1fc-4bef-b221-fd98a804000f" returned: 0 in 0.645s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:40 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-579cd6f8-0d76-4fb3-b9dd-7c316d2a3b41 tempest-VolumesGetTest-1561494887 None] Lock "cinder-quobyte-700ddab8-f1fc-4bef-b221-fd98a804000f" released by "delete_volume" :: held 2.241s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:40 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-579cd6f8-0d76-4fb3-b9dd-7c316d2a3b41 tempest-VolumesGetTest-1561494887 None] Created reservations ['8c1f14ee-6bae-4ede-a8bc-2331e8055d8e', '703c3dd7-5dfc-466a-a2f3-8b92f357c58a', '841b199f-866d-45ca-bb1a-0fed2149a99f', '70d93383-6603-474d-bf48-a04443865422'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:41:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-579cd6f8-0d76-4fb3-b9dd-7c316d2a3b41 tempest-VolumesGetTest-1561494887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-579cd6f8-0d76-4fb3-b9dd-7c316d2a3b41 tempest-VolumesGetTest-1561494887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-579cd6f8-0d76-4fb3-b9dd-7c316d2a3b41 tempest-VolumesGetTest-1561494887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:41:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-579cd6f8-0d76-4fb3-b9dd-7c316d2a3b41 tempest-VolumesGetTest-1561494887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:41:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-579cd6f8-0d76-4fb3-b9dd-7c316d2a3b41 tempest-VolumesGetTest-1561494887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-579cd6f8-0d76-4fb3-b9dd-7c316d2a3b41 tempest-VolumesGetTest-1561494887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:40 devstack sudo[102045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:41:40 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:41 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-579cd6f8-0d76-4fb3-b9dd-7c316d2a3b41 tempest-VolumesGetTest-1561494887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.622s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:41 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-579cd6f8-0d76-4fb3-b9dd-7c316d2a3b41 tempest-VolumesGetTest-1561494887 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:41:41 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-579cd6f8-0d76-4fb3-b9dd-7c316d2a3b41 tempest-VolumesGetTest-1561494887 None] Deleted volume successfully. Jul 06 15:41:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-579cd6f8-0d76-4fb3-b9dd-7c316d2a3b41 tempest-VolumesGetTest-1561494887 None] Lock "cinder-700ddab8-f1fc-4bef-b221-fd98a804000f-delete_volume" released by "delete_volume" :: held 3.119s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:50 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:UPDATE=77,cinder:DELETE=6,cinder:SELECT=58,cinder:INSERT=30 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:41:51 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:INSERT=5,cinder:UPDATE=16,cinder:SELECT=7,cinder:DELETE=1 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:42:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:42:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:42:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:42:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:42:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:42:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:42:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:38 devstack sudo[102205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:42:38 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:39 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.619s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:42:39 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager._thread_info {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:42:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread count: 28 {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:42:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread info: [<_MainThread(MainThread, started 124857273856128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:42:41 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:42:41 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Flow 'volume_create_manager' (f870c633-c973-4bce-aadd-8b6bd2ee1247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:42:41 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68d1b11-8793-4b9a-8b61-03946a2a47e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:42:41 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68d1b11-8793-4b9a-8b61-03946a2a47e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1390634890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3f0802e-7393-4155-a579-ed4126907dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='591cd3e72dd644b78360884b5353e98d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:42:41Z,use_quota=True,user_id='b5c2570ae53e4582b9625c4db32a0243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:42:41 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fa2750f-57bb-4d30-b193-bb7bf7a6a377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:42:41 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fa2750f-57bb-4d30-b193-bb7bf7a6a377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:42:41 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7adffd56-2b25-42ca-aef7-6076889c7881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:42:41 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7adffd56-2b25-42ca-aef7-6076889c7881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3f0802e-7393-4155-a579-ed4126907dbd', 'volume_name': 'volume-d3f0802e-7393-4155-a579-ed4126907dbd', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:42:41 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4814cab4-6393-4e72-b830-6a02dc97635a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:42:41 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4814cab4-6393-4e72-b830-6a02dc97635a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:42:41 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ed7119c-71ba-4fd1-971f-750d00a2dd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:42:41 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Volume d3f0802e-7393-4155-a579-ed4126907dbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3f0802e-7393-4155-a579-ed4126907dbd', 'volume_size': 1} Jul 06 15:42:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:42:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:42:41 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1390634890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3f0802e-7393-4155-a579-ed4126907dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='591cd3e72dd644b78360884b5353e98d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:42:41Z,use_quota=True,user_id='b5c2570ae53e4582b9625c4db32a0243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:42:41 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Creating volume d3f0802e-7393-4155-a579-ed4126907dbd {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:42:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:42:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:42:41 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:42:41 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:42:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:42:41 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:42:41 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:42:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3f0802e-7393-4155-a579-ed4126907dbd 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:41 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3f0802e-7393-4155-a579-ed4126907dbd 1073741824 Jul 06 15:42:41 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:42 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3f0802e-7393-4155-a579-ed4126907dbd 1073741824" returned: 0 in 0.787s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3f0802e-7393-4155-a579-ed4126907dbd {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:42 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3f0802e-7393-4155-a579-ed4126907dbd Jul 06 15:42:42 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:43 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3f0802e-7393-4155-a579-ed4126907dbd" returned: 0 in 0.620s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:43 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:42:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:42:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ed7119c-71ba-4fd1-971f-750d00a2dd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3f0802e-7393-4155-a579-ed4126907dbd', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:42:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f286b05a-f7a0-4f25-b89c-9e76dde46810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:42:43 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Volume volume-d3f0802e-7393-4155-a579-ed4126907dbd (d3f0802e-7393-4155-a579-ed4126907dbd): created successfully Jul 06 15:42:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f286b05a-f7a0-4f25-b89c-9e76dde46810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:42:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Flow 'volume_create_manager' (f870c633-c973-4bce-aadd-8b6bd2ee1247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:42:43 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a3f35962-29aa-4daf-bc7f-33a63fd6bba3 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Created volume successfully. Jul 06 15:42:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-64eb499b-ce3d-487a-a733-588c072de02d req-7769a853-91f9-4619-b138-c409f8414855 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:42:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-64eb499b-ce3d-487a-a733-588c072de02d req-7769a853-91f9-4619-b138-c409f8414855 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:42:46 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba29476c-0eed-44cd-9059-8c301ddd8c26]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:42:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-64eb499b-ce3d-487a-a733-588c072de02d req-7769a853-91f9-4619-b138-c409f8414855 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3f0802e-7393-4155-a579-ed4126907dbd {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:46 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3f0802e-7393-4155-a579-ed4126907dbd Jul 06 15:42:46 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:47 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-64eb499b-ce3d-487a-a733-588c072de02d req-7769a853-91f9-4619-b138-c409f8414855 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3f0802e-7393-4155-a579-ed4126907dbd" returned: 0 in 0.748s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-64eb499b-ce3d-487a-a733-588c072de02d req-7769a853-91f9-4619-b138-c409f8414855 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.762s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:42:47 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-64eb499b-ce3d-487a-a733-588c072de02d req-7769a853-91f9-4619-b138-c409f8414855 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce', 'name': 'volume-d3f0802e-7393-4155-a579-ed4126907dbd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '695aab44-e253-4683-907b-05b467f726f8', 'enforce_multipath': True} {{(pid=86148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:42:47 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-64eb499b-ce3d-487a-a733-588c072de02d req-7769a853-91f9-4619-b138-c409f8414855 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] attachment_update completed successfully. Jul 06 15:42:53 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-ca1b20f5-1b15-43e4-a170-7b1f81da787d req-37d71a35-2e65-43f5-a564-73c6175f4366 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Terminate volume connection completed successfully. Jul 06 15:42:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-ca1b20f5-1b15-43e4-a170-7b1f81da787d req-37d71a35-2e65-43f5-a564-73c6175f4366 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Deleting attachment 695aab44-e253-4683-907b-05b467f726f8. {{(pid=86148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:42:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5a02f816-71a4-4092-8ae2-47cffa030315 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Acquiring lock "cinder-d3f0802e-7393-4155-a579-ed4126907dbd-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:42:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5a02f816-71a4-4092-8ae2-47cffa030315 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Lock "cinder-d3f0802e-7393-4155-a579-ed4126907dbd-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:42:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5a02f816-71a4-4092-8ae2-47cffa030315 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Acquiring lock "cinder-quobyte-d3f0802e-7393-4155-a579-ed4126907dbd" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:42:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5a02f816-71a4-4092-8ae2-47cffa030315 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Lock "cinder-quobyte-d3f0802e-7393-4155-a579-ed4126907dbd" acquired by "delete_volume" :: waited 0.015s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:42:55 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28fd003-729b-4c32-b685-ff943e2eb014]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:42:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5a02f816-71a4-4092-8ae2-47cffa030315 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3f0802e-7393-4155-a579-ed4126907dbd {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:55 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3f0802e-7393-4155-a579-ed4126907dbd Jul 06 15:42:55 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:56 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5a02f816-71a4-4092-8ae2-47cffa030315 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3f0802e-7393-4155-a579-ed4126907dbd" returned: 0 in 0.757s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5a02f816-71a4-4092-8ae2-47cffa030315 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3f0802e-7393-4155-a579-ed4126907dbd {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:56 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3f0802e-7393-4155-a579-ed4126907dbd Jul 06 15:42:56 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:57 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5a02f816-71a4-4092-8ae2-47cffa030315 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3f0802e-7393-4155-a579-ed4126907dbd" returned: 0 in 0.645s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:57 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5a02f816-71a4-4092-8ae2-47cffa030315 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Lock "cinder-quobyte-d3f0802e-7393-4155-a579-ed4126907dbd" released by "delete_volume" :: held 1.440s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:42:57 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-5a02f816-71a4-4092-8ae2-47cffa030315 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Created reservations ['6b98e9a1-2b73-4d72-ba1f-180a7b7990fd', 'b56b3414-f3a8-4e46-b6c6-779db1ce9194', '634e6ae8-b979-4ad3-80f8-54d4f3bd7531', '8b86d0d2-27c1-4042-abce-e6696062f4a0'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:42:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5a02f816-71a4-4092-8ae2-47cffa030315 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:42:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5a02f816-71a4-4092-8ae2-47cffa030315 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:42:57 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5a02f816-71a4-4092-8ae2-47cffa030315 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:42:57 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5a02f816-71a4-4092-8ae2-47cffa030315 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:42:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5a02f816-71a4-4092-8ae2-47cffa030315 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:42:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5a02f816-71a4-4092-8ae2-47cffa030315 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:57 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:42:57 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:57 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5a02f816-71a4-4092-8ae2-47cffa030315 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.621s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:57 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-5a02f816-71a4-4092-8ae2-47cffa030315 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:42:57 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-5a02f816-71a4-4092-8ae2-47cffa030315 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Deleted volume successfully. Jul 06 15:42:57 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5a02f816-71a4-4092-8ae2-47cffa030315 tempest-TestServerVolumeAttachScenarioOldVersion-715819651 None] Lock "cinder-d3f0802e-7393-4155-a579-ed4126907dbd-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:43:07 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=13,cinder:UPDATE=13,cinder:DELETE=1,cinder:INSERT=2 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:43:07 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:UPDATE=13,cinder:SELECT=15,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:43:36 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:43:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Flow 'volume_create_manager' (d440c7d3-afcb-4010-8c6c-01172023e16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:43:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e0f09a-a9c9-4faf-9291-dce6e725565b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e0f09a-a9c9-4faf-9291-dce6e725565b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-618761424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b93119c-ead5-48b9-a2fd-df2d163b8399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ab861187ca4090bd988e4d9e92c78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:43:37Z,use_quota=True,user_id='4b0b9ed8eba64fabb9bd6ea0bc6e055c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f3914e-c7ec-4f2f-bda3-0a9730a7a649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f3914e-c7ec-4f2f-bda3-0a9730a7a649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85feb1fd-90d0-42a9-973b-4724a05ffddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:36 devstack cinder-volume[86148]: DEBUG cinder.image.glance [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Creating Keystone auth plugin from conf {{(pid=86148) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 15:43:37 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85feb1fd-90d0-42a9-973b-4724a05ffddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5b93119c-ead5-48b9-a2fd-df2d163b8399', 'volume_name': 'volume-5b93119c-ead5-48b9-a2fd-df2d163b8399', 'volume_size': 1, 'image_id': 'aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2cea8b96599e40e1978f302796eb3239', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'created_at': datetime.datetime(2026, 7, 6, 13, 18, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 18, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:37 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaac663a-8bda-46a2-86c9-f60628fe81ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:37 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaac663a-8bda-46a2-86c9-f60628fe81ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:37 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d923d4f0-8c0d-4539-8d4e-f9196e9752d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:37 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Volume 5b93119c-ead5-48b9-a2fd-df2d163b8399: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5b93119c-ead5-48b9-a2fd-df2d163b8399', 'volume_size': 1, 'image_id': 'aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2cea8b96599e40e1978f302796eb3239', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'created_at': datetime.datetime(2026, 7, 6, 13, 18, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 18, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 15:43:37 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Trying to clone 5b93119c-ead5-48b9-a2fd-df2d163b8399 from image aab1d6f3-bc8c-4137-9f0e-54346f68c452 at location (None, [{'url': 'file:///opt/stack/data/glance/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'metadata': {}}]). {{(pid=86148) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 15:43:37 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_ees632u9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86148) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 15:43:37 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Image download 20.69 MB at 20.69 MB/s Jul 06 15:43:37 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[390e6bf3-e6f5-4743-9a45-d8c32b853773]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:43:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_ees632u9devstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:37 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_ees632u9devstack@QuobyteHD Jul 06 15:43:37 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:38 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_ees632u9devstack@QuobyteHD" returned: 0 in 0.709s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:38 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Temporary image aab1d6f3-bc8c-4137-9f0e-54346f68c452 is fetched for user 4b0b9ed8eba64fabb9bd6ea0bc6e055c. {{(pid=86148) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 15:43:38 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa28b10-7d99-4cb3-8ee5-dba9d7696aff]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:43:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_ees632u9devstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:38 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_ees632u9devstack@QuobyteHD Jul 06 15:43:38 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:43:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:43:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:43:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:43:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:43:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:43:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:38 devstack sudo[102754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:43:38 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:38 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_ees632u9devstack@QuobyteHD" returned: 0 in 0.734s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:43:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:43:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-618761424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b93119c-ead5-48b9-a2fd-df2d163b8399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ab861187ca4090bd988e4d9e92c78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:43:37Z,use_quota=True,user_id='4b0b9ed8eba64fabb9bd6ea0bc6e055c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:43:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Creating volume 5b93119c-ead5-48b9-a2fd-df2d163b8399 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:43:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:43:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:43:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:43:39 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:43:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:43:39 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:43:39 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:43:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:39 devstack sudo[102760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 1073741824 Jul 06 15:43:39 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:39 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.645s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:43:39 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager._thread_info {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:43:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread count: 28 {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:43:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread info: [<_MainThread(MainThread, started 124857273856128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:43:39 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 1073741824" returned: 0 in 0.787s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:39 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 Jul 06 15:43:39 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:40 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399" returned: 0 in 0.599s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:43:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:43:40 devstack cinder-volume[86148]: DEBUG cinder.volume.volume_utils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Attempting download of aab1d6f3-bc8c-4137-9f0e-54346f68c452 ((None, [{'url': 'file:///opt/stack/data/glance/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'metadata': {}}])) to volume 5b93119c-ead5-48b9-a2fd-df2d163b8399. {{(pid=86148) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 15:43:40 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbf0340-aea2-4e4a-b65c-5e2de6ad9023]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:43:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aab1d6f3-bc8c-4137-9f0e-54346f68c452_j7hhli9l {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:40 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aab1d6f3-bc8c-4137-9f0e-54346f68c452_j7hhli9l Jul 06 15:43:40 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:41 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aab1d6f3-bc8c-4137-9f0e-54346f68c452_j7hhli9l" returned: 0 in 0.673s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aab1d6f3-bc8c-4137-9f0e-54346f68c452_j7hhli9l {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:41 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aab1d6f3-bc8c-4137-9f0e-54346f68c452_j7hhli9l Jul 06 15:43:41 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:41 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aab1d6f3-bc8c-4137-9f0e-54346f68c452_j7hhli9l" returned: 1 in 0.688s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aab1d6f3-bc8c-4137-9f0e-54346f68c452_j7hhli9l' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:43:41 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[2facc869-7a12-4bb2-904f-b594f572535f]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:43:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_ees632u9devstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:41 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_ees632u9devstack@QuobyteHD Jul 06 15:43:41 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:42 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_ees632u9devstack@QuobyteHD" returned: 0 in 0.674s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:42 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] aab1d6f3-bc8c-4137-9f0e-54346f68c452 was qcow2, converting to raw {{(pid=86148) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 15:43:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_ees632u9devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:42 devstack sudo[102783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_ees632u9devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 Jul 06 15:43:42 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:44 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_ees632u9devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399" returned: 0 in 1.741s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:44 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aab1d6f3-bc8c-4137-9f0e-54346f68c452_ees632u9devstack@QuobyteHD, size 112.00 MB, duration 1.74 sec, destination /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 {{(pid=86148) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:43:44 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Converted 112.00 MB image at 64.28 MB/s Jul 06 15:43:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:44 devstack sudo[102826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 1G Jul 06 15:43:44 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:44 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 1G" returned: 0 in 0.699s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:45 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b53b313-131a-4c92-88d0-bf0a6f0ec24e]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:43:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:45 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 Jul 06 15:43:45 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:45 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399" returned: 0 in 0.700s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:45 devstack sudo[102837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 Jul 06 15:43:45 devstack sudo[102837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:46 devstack sudo[102837]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399" returned: 1 in 0.696s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:43:46 devstack cinder-volume[86148]: DEBUG cinder.volume.volume_utils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Downloaded image aab1d6f3-bc8c-4137-9f0e-54346f68c452 ((None, [{'url': 'file:///opt/stack/data/glance/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'metadata': {}}])) to volume 5b93119c-ead5-48b9-a2fd-df2d163b8399 successfully. {{(pid=86148) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 15:43:46 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Temporary image aab1d6f3-bc8c-4137-9f0e-54346f68c452 for user 4b0b9ed8eba64fabb9bd6ea0bc6e055c is deleted. {{(pid=86148) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 15:43:46 devstack cinder-volume[86148]: DEBUG cinder.volume.volume_utils [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Marking volume 5b93119c-ead5-48b9-a2fd-df2d163b8399 as bootable. {{(pid=86148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 15:43:46 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Copying metadata from image aab1d6f3-bc8c-4137-9f0e-54346f68c452 to 5b93119c-ead5-48b9-a2fd-df2d163b8399. {{(pid=86148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 15:43:46 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Creating volume glance metadata for volume 5b93119c-ead5-48b9-a2fd-df2d163b8399 backed by image aab1d6f3-bc8c-4137-9f0e-54346f68c452 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86148) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 15:43:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d923d4f0-8c0d-4539-8d4e-f9196e9752d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b93119c-ead5-48b9-a2fd-df2d163b8399', 'volume_size': 1, 'image_id': 'aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2cea8b96599e40e1978f302796eb3239', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aab1d6f3-bc8c-4137-9f0e-54346f68c452', 'created_at': datetime.datetime(2026, 7, 6, 13, 18, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 18, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aab1d6f3-bc8c-4137-9f0e-54346f68c452/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9ac436-b271-42e5-8471-c25086a25809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:46 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Volume volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 (5b93119c-ead5-48b9-a2fd-df2d163b8399): created successfully Jul 06 15:43:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9ac436-b271-42e5-8471-c25086a25809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Flow 'volume_create_manager' (d440c7d3-afcb-4010-8c6c-01172023e16e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:43:46 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-bd6904f7-8fe4-4c02-9006-9ab71c4201b0 tempest-TestShelveInstance-378661736 None] Created volume successfully. Jul 06 15:43:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-2706ba4e-1b32-470e-9c78-71889f0a2280 req-f3810f7e-8b92-4c0c-8f4d-cf9c2666510f tempest-TestShelveInstance-378661736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:43:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-2706ba4e-1b32-470e-9c78-71889f0a2280 req-f3810f7e-8b92-4c0c-8f4d-cf9c2666510f tempest-TestShelveInstance-378661736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:43:54 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf33408-a290-4d3b-a8f6-26d5694e6e2c]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:43:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-2706ba4e-1b32-470e-9c78-71889f0a2280 req-f3810f7e-8b92-4c0c-8f4d-cf9c2666510f tempest-TestShelveInstance-378661736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:54 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 Jul 06 15:43:54 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:55 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-2706ba4e-1b32-470e-9c78-71889f0a2280 req-f3810f7e-8b92-4c0c-8f4d-cf9c2666510f tempest-TestShelveInstance-378661736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399" returned: 0 in 0.742s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-2706ba4e-1b32-470e-9c78-71889f0a2280 req-f3810f7e-8b92-4c0c-8f4d-cf9c2666510f tempest-TestShelveInstance-378661736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:55 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 Jul 06 15:43:55 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:55 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-2706ba4e-1b32-470e-9c78-71889f0a2280 req-f3810f7e-8b92-4c0c-8f4d-cf9c2666510f tempest-TestShelveInstance-378661736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399" returned: 1 in 0.718s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-2706ba4e-1b32-470e-9c78-71889f0a2280 req-f3810f7e-8b92-4c0c-8f4d-cf9c2666510f tempest-TestShelveInstance-378661736 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:43:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-2706ba4e-1b32-470e-9c78-71889f0a2280 req-f3810f7e-8b92-4c0c-8f4d-cf9c2666510f tempest-TestShelveInstance-378661736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.498s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:43:55 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-2706ba4e-1b32-470e-9c78-71889f0a2280 req-f3810f7e-8b92-4c0c-8f4d-cf9c2666510f tempest-TestShelveInstance-378661736 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce', 'name': 'volume-5b93119c-ead5-48b9-a2fd-df2d163b8399', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fa8ac9e6-5ec6-4b3c-988d-2124292fb85c', 'enforce_multipath': True} {{(pid=86148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:43:55 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-2706ba4e-1b32-470e-9c78-71889f0a2280 req-f3810f7e-8b92-4c0c-8f4d-cf9c2666510f tempest-TestShelveInstance-378661736 None] attachment_update completed successfully. Jul 06 15:44:05 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:UPDATE=10,cinder:INSERT=6,cinder:SELECT=8,cinder:DELETE=1 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:44:05 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=22,cinder:INSERT=8,cinder:UPDATE=2 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:44:32 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-3cd50a2d-bcad-47a6-b3c0-60af5f2a7443 req-b0c1dd9d-9ae5-42fa-8ac3-f8611287f784 tempest-TestShelveInstance-378661736 None] Terminate volume connection completed successfully. Jul 06 15:44:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-3cd50a2d-bcad-47a6-b3c0-60af5f2a7443 req-b0c1dd9d-9ae5-42fa-8ac3-f8611287f784 tempest-TestShelveInstance-378661736 None] Deleting attachment fa8ac9e6-5ec6-4b3c-988d-2124292fb85c. {{(pid=86148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:44:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-5673afde-05f6-45e1-99ec-22a4cdfc6808 req-e05b096e-685f-445e-b8e7-5a8a0a72c3a0 tempest-TestShelveInstance-378661736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-5673afde-05f6-45e1-99ec-22a4cdfc6808 req-e05b096e-685f-445e-b8e7-5a8a0a72c3a0 tempest-TestShelveInstance-378661736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:36 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc8d2a5-edd4-4d71-a7bf-7fe02f712a2d]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:44:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-5673afde-05f6-45e1-99ec-22a4cdfc6808 req-e05b096e-685f-445e-b8e7-5a8a0a72c3a0 tempest-TestShelveInstance-378661736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:36 devstack sudo[103474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 Jul 06 15:44:36 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:37 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-5673afde-05f6-45e1-99ec-22a4cdfc6808 req-e05b096e-685f-445e-b8e7-5a8a0a72c3a0 tempest-TestShelveInstance-378661736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399" returned: 0 in 0.692s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-5673afde-05f6-45e1-99ec-22a4cdfc6808 req-e05b096e-685f-445e-b8e7-5a8a0a72c3a0 tempest-TestShelveInstance-378661736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:37 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 Jul 06 15:44:37 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:38 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-5673afde-05f6-45e1-99ec-22a4cdfc6808 req-e05b096e-685f-445e-b8e7-5a8a0a72c3a0 tempest-TestShelveInstance-378661736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399" returned: 1 in 0.697s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-5673afde-05f6-45e1-99ec-22a4cdfc6808 req-e05b096e-685f-445e-b8e7-5a8a0a72c3a0 tempest-TestShelveInstance-378661736 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:44:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-5673afde-05f6-45e1-99ec-22a4cdfc6808 req-e05b096e-685f-445e-b8e7-5a8a0a72c3a0 tempest-TestShelveInstance-378661736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.432s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:38 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-5673afde-05f6-45e1-99ec-22a4cdfc6808 req-e05b096e-685f-445e-b8e7-5a8a0a72c3a0 tempest-TestShelveInstance-378661736 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce', 'name': 'volume-5b93119c-ead5-48b9-a2fd-df2d163b8399', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd931c9d1-798b-42d6-bb1b-ff5dd379e19a', 'enforce_multipath': True} {{(pid=86148) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:44:38 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-5673afde-05f6-45e1-99ec-22a4cdfc6808 req-e05b096e-685f-445e-b8e7-5a8a0a72c3a0 tempest-TestShelveInstance-378661736 None] attachment_update completed successfully. Jul 06 15:44:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:44:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:38 devstack sudo[103483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:44:38 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:39 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.626s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:44:39 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager._thread_info {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:44:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread count: 28 {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:44:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread info: [<_MainThread(MainThread, started 124857273856128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:44:48 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:44:48 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=9 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:44:58 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=1 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:44:58 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:UPDATE=1 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:45:31 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-2bd7dcf4-a97f-4729-ac64-154f91e44ca6 req-6b755f11-9cad-4ec7-8713-8ee89be9e2e3 tempest-TestShelveInstance-378661736 None] Terminate volume connection completed successfully. Jul 06 15:45:31 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [req-2bd7dcf4-a97f-4729-ac64-154f91e44ca6 req-6b755f11-9cad-4ec7-8713-8ee89be9e2e3 tempest-TestShelveInstance-378661736 None] Deleting attachment d931c9d1-798b-42d6-bb1b-ff5dd379e19a. {{(pid=86148) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:45:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [req-2bd7dcf4-a97f-4729-ac64-154f91e44ca6 req-d65443a7-a18d-4734-8b1f-bc8f801ea5d1 tempest-TestShelveInstance-378661736 None] Acquiring lock "cinder-5b93119c-ead5-48b9-a2fd-df2d163b8399-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [req-2bd7dcf4-a97f-4729-ac64-154f91e44ca6 req-d65443a7-a18d-4734-8b1f-bc8f801ea5d1 tempest-TestShelveInstance-378661736 None] Lock "cinder-5b93119c-ead5-48b9-a2fd-df2d163b8399-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [req-2bd7dcf4-a97f-4729-ac64-154f91e44ca6 req-d65443a7-a18d-4734-8b1f-bc8f801ea5d1 tempest-TestShelveInstance-378661736 None] Acquiring lock "cinder-quobyte-5b93119c-ead5-48b9-a2fd-df2d163b8399" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [req-2bd7dcf4-a97f-4729-ac64-154f91e44ca6 req-d65443a7-a18d-4734-8b1f-bc8f801ea5d1 tempest-TestShelveInstance-378661736 None] Lock "cinder-quobyte-5b93119c-ead5-48b9-a2fd-df2d163b8399" acquired by "delete_volume" :: waited 0.015s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:32 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72ddc3f-381a-44b0-8b21-da32ddec2f7f]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:45:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-2bd7dcf4-a97f-4729-ac64-154f91e44ca6 req-d65443a7-a18d-4734-8b1f-bc8f801ea5d1 tempest-TestShelveInstance-378661736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:32 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 Jul 06 15:45:32 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:32 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-2bd7dcf4-a97f-4729-ac64-154f91e44ca6 req-d65443a7-a18d-4734-8b1f-bc8f801ea5d1 tempest-TestShelveInstance-378661736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399" returned: 0 in 0.739s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-2bd7dcf4-a97f-4729-ac64-154f91e44ca6 req-d65443a7-a18d-4734-8b1f-bc8f801ea5d1 tempest-TestShelveInstance-378661736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:32 devstack sudo[104057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 Jul 06 15:45:32 devstack sudo[104057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:33 devstack sudo[104057]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-2bd7dcf4-a97f-4729-ac64-154f91e44ca6 req-d65443a7-a18d-4734-8b1f-bc8f801ea5d1 tempest-TestShelveInstance-378661736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399" returned: 1 in 0.698s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-2bd7dcf4-a97f-4729-ac64-154f91e44ca6 req-d65443a7-a18d-4734-8b1f-bc8f801ea5d1 tempest-TestShelveInstance-378661736 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:45:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-2bd7dcf4-a97f-4729-ac64-154f91e44ca6 req-d65443a7-a18d-4734-8b1f-bc8f801ea5d1 tempest-TestShelveInstance-378661736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:33 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399 Jul 06 15:45:33 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:34 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-2bd7dcf4-a97f-4729-ac64-154f91e44ca6 req-d65443a7-a18d-4734-8b1f-bc8f801ea5d1 tempest-TestShelveInstance-378661736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5b93119c-ead5-48b9-a2fd-df2d163b8399" returned: 0 in 0.630s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:34 devstack cinder-volume[86148]: DEBUG cinder.coordination [req-2bd7dcf4-a97f-4729-ac64-154f91e44ca6 req-d65443a7-a18d-4734-8b1f-bc8f801ea5d1 tempest-TestShelveInstance-378661736 None] Lock "cinder-quobyte-5b93119c-ead5-48b9-a2fd-df2d163b8399" released by "delete_volume" :: held 2.129s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:34 devstack cinder-volume[86148]: DEBUG cinder.quota [req-2bd7dcf4-a97f-4729-ac64-154f91e44ca6 req-d65443a7-a18d-4734-8b1f-bc8f801ea5d1 tempest-TestShelveInstance-378661736 None] Created reservations ['2a1c7087-c821-4cd6-aa18-f32e11a1ec13', '4dd3111d-eecc-4a28-a74c-70fe8f6ae37c', '4eeaaff8-a46d-43e8-b22f-1acb8acb98a2', 'ef26b6f5-084f-4afe-9447-8cd356bad716'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:45:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-2bd7dcf4-a97f-4729-ac64-154f91e44ca6 req-d65443a7-a18d-4734-8b1f-bc8f801ea5d1 tempest-TestShelveInstance-378661736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-2bd7dcf4-a97f-4729-ac64-154f91e44ca6 req-d65443a7-a18d-4734-8b1f-bc8f801ea5d1 tempest-TestShelveInstance-378661736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [req-2bd7dcf4-a97f-4729-ac64-154f91e44ca6 req-d65443a7-a18d-4734-8b1f-bc8f801ea5d1 tempest-TestShelveInstance-378661736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [req-2bd7dcf4-a97f-4729-ac64-154f91e44ca6 req-d65443a7-a18d-4734-8b1f-bc8f801ea5d1 tempest-TestShelveInstance-378661736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [req-2bd7dcf4-a97f-4729-ac64-154f91e44ca6 req-d65443a7-a18d-4734-8b1f-bc8f801ea5d1 tempest-TestShelveInstance-378661736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-2bd7dcf4-a97f-4729-ac64-154f91e44ca6 req-d65443a7-a18d-4734-8b1f-bc8f801ea5d1 tempest-TestShelveInstance-378661736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:34 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:45:34 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:34 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [req-2bd7dcf4-a97f-4729-ac64-154f91e44ca6 req-d65443a7-a18d-4734-8b1f-bc8f801ea5d1 tempest-TestShelveInstance-378661736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.653s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:34 devstack cinder-volume[86148]: DEBUG cinder.manager [req-2bd7dcf4-a97f-4729-ac64-154f91e44ca6 req-d65443a7-a18d-4734-8b1f-bc8f801ea5d1 tempest-TestShelveInstance-378661736 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:45:34 devstack cinder-volume[86148]: INFO cinder.volume.manager [req-2bd7dcf4-a97f-4729-ac64-154f91e44ca6 req-d65443a7-a18d-4734-8b1f-bc8f801ea5d1 tempest-TestShelveInstance-378661736 None] Deleted volume successfully. Jul 06 15:45:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [req-2bd7dcf4-a97f-4729-ac64-154f91e44ca6 req-d65443a7-a18d-4734-8b1f-bc8f801ea5d1 tempest-TestShelveInstance-378661736 None] Lock "cinder-5b93119c-ead5-48b9-a2fd-df2d163b8399-delete_volume" released by "delete_volume" :: held 2.981s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:45:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:38 devstack sudo[104073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:45:38 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:39 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.655s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:45:39 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager._thread_info {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:45:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread count: 28 {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:45:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread info: [<_MainThread(MainThread, started 124857273856128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:45:44 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=10 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:45:44 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:45:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Flow 'volume_create_manager' (823dda5e-aa1d-4ccc-95da-de0561a99fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:45:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afec8435-bfd9-47d7-9ac6-9530d5444ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afec8435-bfd9-47d7-9ac6-9530d5444ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1129161762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5917527-f159-42cd-a8ba-a57ce4196b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2473ffe45f644a26948ac47fced5d1aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:45Z,use_quota=True,user_id='11d9528aa1f44b86b3672e3030508500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a2652f-d852-4c80-bd7a-3ff7a90e7b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a2652f-d852-4c80-bd7a-3ff7a90e7b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e31fab-1205-48a0-8a0b-f68a3fba396b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e31fab-1205-48a0-8a0b-f68a3fba396b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5917527-f159-42cd-a8ba-a57ce4196b13', 'volume_name': 'volume-f5917527-f159-42cd-a8ba-a57ce4196b13', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b515a1-1b5d-4d19-9551-b3c8c8a304a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b515a1-1b5d-4d19-9551-b3c8c8a304a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d11a3578-4a64-4dbe-ba86-689b4a48516d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:44 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Volume f5917527-f159-42cd-a8ba-a57ce4196b13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5917527-f159-42cd-a8ba-a57ce4196b13', 'volume_size': 1} Jul 06 15:45:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1129161762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5917527-f159-42cd-a8ba-a57ce4196b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2473ffe45f644a26948ac47fced5d1aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:45Z,use_quota=True,user_id='11d9528aa1f44b86b3672e3030508500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:45:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Creating volume f5917527-f159-42cd-a8ba-a57ce4196b13 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:45:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:45:44 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:45:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5917527-f159-42cd-a8ba-a57ce4196b13 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:44 devstack sudo[104113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5917527-f159-42cd-a8ba-a57ce4196b13 1073741824 Jul 06 15:45:44 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:45 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:45:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Flow 'volume_create_manager' (27c65b21-041b-4326-8ced-220b3874cef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:45:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4601d3e-3397-49f6-aa99-4f51b60b7945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4601d3e-3397-49f6-aa99-4f51b60b7945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-244922021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d75f397-7c06-4aa4-bdbc-b1948fea7ea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2473ffe45f644a26948ac47fced5d1aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:45Z,use_quota=True,user_id='11d9528aa1f44b86b3672e3030508500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4378ef5-51b1-4f44-b2ed-07a16f051980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4378ef5-51b1-4f44-b2ed-07a16f051980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16f23142-59ee-44c8-819a-bc22e4c73052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16f23142-59ee-44c8-819a-bc22e4c73052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d75f397-7c06-4aa4-bdbc-b1948fea7ea0', 'volume_name': 'volume-2d75f397-7c06-4aa4-bdbc-b1948fea7ea0', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3bc48bd-bcec-4352-8f9a-8d9e817fcd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3bc48bd-bcec-4352-8f9a-8d9e817fcd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7a679f-8646-4b9b-b7b4-68a60d4c1a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:45 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Volume 2d75f397-7c06-4aa4-bdbc-b1948fea7ea0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d75f397-7c06-4aa4-bdbc-b1948fea7ea0', 'volume_size': 1} Jul 06 15:45:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:45 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:45:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Flow 'volume_create_manager' (64a24d28-38d2-452f-9031-ddc356c227bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:45:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d78ce23-a307-45d4-80d1-6aa00cc2ed6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d78ce23-a307-45d4-80d1-6aa00cc2ed6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-106634623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81fd1655-9e10-40d9-acdc-3ab6148edce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2473ffe45f644a26948ac47fced5d1aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:46Z,use_quota=True,user_id='11d9528aa1f44b86b3672e3030508500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a2a9ea2-476c-4f8e-a9f7-824649b41034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a2a9ea2-476c-4f8e-a9f7-824649b41034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d528fb9-1aec-4bc2-9f02-558aac228acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d528fb9-1aec-4bc2-9f02-558aac228acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81fd1655-9e10-40d9-acdc-3ab6148edce7', 'volume_name': 'volume-81fd1655-9e10-40d9-acdc-3ab6148edce7', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447118de-a099-416f-bcf4-2e47b5c6966b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447118de-a099-416f-bcf4-2e47b5c6966b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3512b9c8-31e2-48c5-950e-51c9e93ac1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:45 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Volume 81fd1655-9e10-40d9-acdc-3ab6148edce7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81fd1655-9e10-40d9-acdc-3ab6148edce7', 'volume_size': 1} Jul 06 15:45:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:45 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:45:45 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Flow 'volume_create_manager' (e1d9e01e-9e18-4756-a1fe-2db00a1c3a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c66421b-d614-40b1-a88a-91744701c0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5917527-f159-42cd-a8ba-a57ce4196b13 1073741824" returned: 0 in 1.083s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c66421b-d614-40b1-a88a-91744701c0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-762647496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed2ebde-dabe-4d59-986a-a1abd6d9d9ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2473ffe45f644a26948ac47fced5d1aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:46Z,use_quota=True,user_id='11d9528aa1f44b86b3672e3030508500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d1bc87a-fed4-4743-a529-d7542350e6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d1bc87a-fed4-4743-a529-d7542350e6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b82d04db-66ba-4519-9f4b-6bb9ace9b582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b82d04db-66ba-4519-9f4b-6bb9ace9b582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ed2ebde-dabe-4d59-986a-a1abd6d9d9ca', 'volume_name': 'volume-9ed2ebde-dabe-4d59-986a-a1abd6d9d9ca', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a03a3930-775d-455d-a2cc-c4d2dec6eef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a03a3930-775d-455d-a2cc-c4d2dec6eef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33c3b592-41cd-484f-8cc3-f7df9377db86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:46 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Volume 9ed2ebde-dabe-4d59-986a-a1abd6d9d9ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ed2ebde-dabe-4d59-986a-a1abd6d9d9ca', 'volume_size': 1} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5917527-f159-42cd-a8ba-a57ce4196b13 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:46 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5917527-f159-42cd-a8ba-a57ce4196b13 Jul 06 15:45:46 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Flow 'volume_create_manager' (e7185480-1b08-43ca-bd9c-078b5cdff508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7147be82-50df-4be5-a8e9-5f38bfe53901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7147be82-50df-4be5-a8e9-5f38bfe53901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-186185317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ebde87-b6d7-4e99-8a35-052ce4599e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2473ffe45f644a26948ac47fced5d1aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:46Z,use_quota=True,user_id='11d9528aa1f44b86b3672e3030508500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d39674-324a-4d07-950a-ec0fe261647b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d39674-324a-4d07-950a-ec0fe261647b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1de0f3f-9d6c-45dc-8135-2f589516a493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1de0f3f-9d6c-45dc-8135-2f589516a493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5ebde87-b6d7-4e99-8a35-052ce4599e2e', 'volume_name': 'volume-c5ebde87-b6d7-4e99-8a35-052ce4599e2e', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24499d39-1844-4c4f-9c9f-b12f86e4acb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24499d39-1844-4c4f-9c9f-b12f86e4acb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48dcc000-0866-4e3c-8f81-4a5b96a319bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:46 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Volume c5ebde87-b6d7-4e99-8a35-052ce4599e2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5ebde87-b6d7-4e99-8a35-052ce4599e2e', 'volume_size': 1} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:46 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5917527-f159-42cd-a8ba-a57ce4196b13" returned: 0 in 0.693s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.480s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-244922021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d75f397-7c06-4aa4-bdbc-b1948fea7ea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2473ffe45f644a26948ac47fced5d1aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:45Z,use_quota=True,user_id='11d9528aa1f44b86b3672e3030508500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Creating volume 2d75f397-7c06-4aa4-bdbc-b1948fea7ea0 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:45:46 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2d75f397-7c06-4aa4-bdbc-b1948fea7ea0 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d11a3578-4a64-4dbe-ba86-689b4a48516d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5917527-f159-42cd-a8ba-a57ce4196b13', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:46 devstack sudo[104123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2d75f397-7c06-4aa4-bdbc-b1948fea7ea0 1073741824 Jul 06 15:45:46 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51db68bc-565a-4163-a8bb-cb750bf289ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:46 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Volume volume-f5917527-f159-42cd-a8ba-a57ce4196b13 (f5917527-f159-42cd-a8ba-a57ce4196b13): created successfully Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51db68bc-565a-4163-a8bb-cb750bf289ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Flow 'volume_create_manager' (823dda5e-aa1d-4ccc-95da-de0561a99fbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:45:46 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-20f78815-4fef-4bd5-9c35-858bb63a62e0 tempest-CreateVolumesFromImageTest-1347090827 None] Created volume successfully. Jul 06 15:45:47 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2d75f397-7c06-4aa4-bdbc-b1948fea7ea0 1073741824" returned: 0 in 0.807s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2d75f397-7c06-4aa4-bdbc-b1948fea7ea0 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:47 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2d75f397-7c06-4aa4-bdbc-b1948fea7ea0 Jul 06 15:45:47 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:48 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2d75f397-7c06-4aa4-bdbc-b1948fea7ea0" returned: 0 in 0.604s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:48 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:45:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.463s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:48 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-106634623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81fd1655-9e10-40d9-acdc-3ab6148edce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2473ffe45f644a26948ac47fced5d1aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:46Z,use_quota=True,user_id='11d9528aa1f44b86b3672e3030508500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:45:48 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Creating volume 81fd1655-9e10-40d9-acdc-3ab6148edce7 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:45:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:48 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:48 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:48 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:45:48 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:45:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81fd1655-9e10-40d9-acdc-3ab6148edce7 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7a679f-8646-4b9b-b7b4-68a60d4c1a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d75f397-7c06-4aa4-bdbc-b1948fea7ea0', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:48 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81fd1655-9e10-40d9-acdc-3ab6148edce7 1073741824 Jul 06 15:45:48 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9686b5e-d482-402f-a3af-7286f3bb2e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:48 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Volume volume-2d75f397-7c06-4aa4-bdbc-b1948fea7ea0 (2d75f397-7c06-4aa4-bdbc-b1948fea7ea0): created successfully Jul 06 15:45:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9686b5e-d482-402f-a3af-7286f3bb2e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Flow 'volume_create_manager' (27c65b21-041b-4326-8ced-220b3874cef3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:45:48 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-1378d3c3-9e1f-42e6-89b9-d68fecdf69d7 tempest-CreateVolumesFromImageTest-1347090827 None] Created volume successfully. Jul 06 15:45:49 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81fd1655-9e10-40d9-acdc-3ab6148edce7 1073741824" returned: 0 in 0.787s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81fd1655-9e10-40d9-acdc-3ab6148edce7 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:49 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81fd1655-9e10-40d9-acdc-3ab6148edce7 Jul 06 15:45:49 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:49 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81fd1655-9e10-40d9-acdc-3ab6148edce7" returned: 0 in 0.624s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:45:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.624s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-762647496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed2ebde-dabe-4d59-986a-a1abd6d9d9ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2473ffe45f644a26948ac47fced5d1aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:46Z,use_quota=True,user_id='11d9528aa1f44b86b3672e3030508500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:45:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Creating volume 9ed2ebde-dabe-4d59-986a-a1abd6d9d9ca {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:45:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:45:49 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:45:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9ed2ebde-dabe-4d59-986a-a1abd6d9d9ca 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3512b9c8-31e2-48c5-950e-51c9e93ac1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81fd1655-9e10-40d9-acdc-3ab6148edce7', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:49 devstack sudo[104140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9ed2ebde-dabe-4d59-986a-a1abd6d9d9ca 1073741824 Jul 06 15:45:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e03929-1f32-4231-af90-a4c2e60b2fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:49 devstack sudo[104140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:49 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Volume volume-81fd1655-9e10-40d9-acdc-3ab6148edce7 (81fd1655-9e10-40d9-acdc-3ab6148edce7): created successfully Jul 06 15:45:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e03929-1f32-4231-af90-a4c2e60b2fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:49 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Flow 'volume_create_manager' (64a24d28-38d2-452f-9031-ddc356c227bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:45:49 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-2efa4ca7-7daf-46ca-89f6-35781588dc2a tempest-CreateVolumesFromImageTest-1347090827 None] Created volume successfully. Jul 06 15:45:50 devstack sudo[104140]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9ed2ebde-dabe-4d59-986a-a1abd6d9d9ca 1073741824" returned: 0 in 0.773s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9ed2ebde-dabe-4d59-986a-a1abd6d9d9ca {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:50 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9ed2ebde-dabe-4d59-986a-a1abd6d9d9ca Jul 06 15:45:50 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:51 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9ed2ebde-dabe-4d59-986a-a1abd6d9d9ca" returned: 0 in 0.601s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:45:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.683s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-186185317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ebde87-b6d7-4e99-8a35-052ce4599e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2473ffe45f644a26948ac47fced5d1aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:46Z,use_quota=True,user_id='11d9528aa1f44b86b3672e3030508500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:45:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Creating volume c5ebde87-b6d7-4e99-8a35-052ce4599e2e {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:45:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:45:51 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:45:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c5ebde87-b6d7-4e99-8a35-052ce4599e2e 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33c3b592-41cd-484f-8cc3-f7df9377db86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ed2ebde-dabe-4d59-986a-a1abd6d9d9ca', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:51 devstack sudo[104149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c5ebde87-b6d7-4e99-8a35-052ce4599e2e 1073741824 Jul 06 15:45:51 devstack sudo[104149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5eb4d99-cbdc-4ed2-a4dd-9903fba1fa62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:51 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Volume volume-9ed2ebde-dabe-4d59-986a-a1abd6d9d9ca (9ed2ebde-dabe-4d59-986a-a1abd6d9d9ca): created successfully Jul 06 15:45:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5eb4d99-cbdc-4ed2-a4dd-9903fba1fa62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Flow 'volume_create_manager' (e1d9e01e-9e18-4756-a1fe-2db00a1c3a16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:45:51 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-33b41dd6-6475-432e-bce1-93eb63a40fb1 tempest-CreateVolumesFromImageTest-1347090827 None] Created volume successfully. Jul 06 15:45:51 devstack sudo[104149]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c5ebde87-b6d7-4e99-8a35-052ce4599e2e 1073741824" returned: 0 in 0.866s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c5ebde87-b6d7-4e99-8a35-052ce4599e2e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:52 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c5ebde87-b6d7-4e99-8a35-052ce4599e2e Jul 06 15:45:52 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:52 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c5ebde87-b6d7-4e99-8a35-052ce4599e2e" returned: 0 in 0.613s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:52 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:45:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48dcc000-0866-4e3c-8f81-4a5b96a319bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5ebde87-b6d7-4e99-8a35-052ce4599e2e', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8929aba4-7a4c-4810-8cb3-d222d1cefa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:52 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Volume volume-c5ebde87-b6d7-4e99-8a35-052ce4599e2e (c5ebde87-b6d7-4e99-8a35-052ce4599e2e): created successfully Jul 06 15:45:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8929aba4-7a4c-4810-8cb3-d222d1cefa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Flow 'volume_create_manager' (e7185480-1b08-43ca-bd9c-078b5cdff508) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:45:52 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-b4d3c350-0092-4b1f-9887-2d594b1aad6e tempest-CreateVolumesFromImageTest-1347090827 None] Created volume successfully. Jul 06 15:45:52 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-264f5aca-e551-4324-86de-29e2b2435200 tempest-CreateVolumesFromImageTest-1347090827 None] Acquiring lock "cinder-c5ebde87-b6d7-4e99-8a35-052ce4599e2e-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:52 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-264f5aca-e551-4324-86de-29e2b2435200 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "cinder-c5ebde87-b6d7-4e99-8a35-052ce4599e2e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:52 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-264f5aca-e551-4324-86de-29e2b2435200 tempest-CreateVolumesFromImageTest-1347090827 None] Acquiring lock "cinder-quobyte-c5ebde87-b6d7-4e99-8a35-052ce4599e2e" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:52 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-264f5aca-e551-4324-86de-29e2b2435200 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "cinder-quobyte-c5ebde87-b6d7-4e99-8a35-052ce4599e2e" acquired by "delete_volume" :: waited 0.017s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:52 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85a0d3d-3f3b-45c6-81b9-cbe9e935d8b7]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:45:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-264f5aca-e551-4324-86de-29e2b2435200 tempest-CreateVolumesFromImageTest-1347090827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c5ebde87-b6d7-4e99-8a35-052ce4599e2e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:53 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c5ebde87-b6d7-4e99-8a35-052ce4599e2e Jul 06 15:45:53 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:53 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-264f5aca-e551-4324-86de-29e2b2435200 tempest-CreateVolumesFromImageTest-1347090827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c5ebde87-b6d7-4e99-8a35-052ce4599e2e" returned: 0 in 0.718s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-264f5aca-e551-4324-86de-29e2b2435200 tempest-CreateVolumesFromImageTest-1347090827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c5ebde87-b6d7-4e99-8a35-052ce4599e2e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:53 devstack sudo[104168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c5ebde87-b6d7-4e99-8a35-052ce4599e2e Jul 06 15:45:53 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:54 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-264f5aca-e551-4324-86de-29e2b2435200 tempest-CreateVolumesFromImageTest-1347090827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c5ebde87-b6d7-4e99-8a35-052ce4599e2e" returned: 0 in 0.604s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-264f5aca-e551-4324-86de-29e2b2435200 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "cinder-quobyte-c5ebde87-b6d7-4e99-8a35-052ce4599e2e" released by "delete_volume" :: held 1.367s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:54 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-264f5aca-e551-4324-86de-29e2b2435200 tempest-CreateVolumesFromImageTest-1347090827 None] Created reservations ['390e2229-4bf2-4e2c-a4f2-18a032b2a3dd', '09a09a3c-de9c-4288-acc2-1dc263984b40', 'cbfdde7a-e2cc-489f-a6c3-d72b23ac8961', '6d41e572-2dda-4818-9a22-7b49fdac2590'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:45:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-264f5aca-e551-4324-86de-29e2b2435200 tempest-CreateVolumesFromImageTest-1347090827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-264f5aca-e551-4324-86de-29e2b2435200 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-264f5aca-e551-4324-86de-29e2b2435200 tempest-CreateVolumesFromImageTest-1347090827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-264f5aca-e551-4324-86de-29e2b2435200 tempest-CreateVolumesFromImageTest-1347090827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-264f5aca-e551-4324-86de-29e2b2435200 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-264f5aca-e551-4324-86de-29e2b2435200 tempest-CreateVolumesFromImageTest-1347090827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:54 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:45:54 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:55 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-264f5aca-e551-4324-86de-29e2b2435200 tempest-CreateVolumesFromImageTest-1347090827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.611s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:55 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-264f5aca-e551-4324-86de-29e2b2435200 tempest-CreateVolumesFromImageTest-1347090827 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:45:55 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-264f5aca-e551-4324-86de-29e2b2435200 tempest-CreateVolumesFromImageTest-1347090827 None] Deleted volume successfully. Jul 06 15:45:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-264f5aca-e551-4324-86de-29e2b2435200 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "cinder-c5ebde87-b6d7-4e99-8a35-052ce4599e2e-delete_volume" released by "delete_volume" :: held 2.170s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8b8f098f-80c2-4377-a99a-3879445cd020 tempest-CreateVolumesFromImageTest-1347090827 None] Acquiring lock "cinder-9ed2ebde-dabe-4d59-986a-a1abd6d9d9ca-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8b8f098f-80c2-4377-a99a-3879445cd020 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "cinder-9ed2ebde-dabe-4d59-986a-a1abd6d9d9ca-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8b8f098f-80c2-4377-a99a-3879445cd020 tempest-CreateVolumesFromImageTest-1347090827 None] Acquiring lock "cinder-quobyte-9ed2ebde-dabe-4d59-986a-a1abd6d9d9ca" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8b8f098f-80c2-4377-a99a-3879445cd020 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "cinder-quobyte-9ed2ebde-dabe-4d59-986a-a1abd6d9d9ca" acquired by "delete_volume" :: waited 0.015s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:55 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3e99ae-61e3-4d29-b5f9-50386ad7e1ab]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:45:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8b8f098f-80c2-4377-a99a-3879445cd020 tempest-CreateVolumesFromImageTest-1347090827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9ed2ebde-dabe-4d59-986a-a1abd6d9d9ca {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:55 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9ed2ebde-dabe-4d59-986a-a1abd6d9d9ca Jul 06 15:45:55 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:55 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8b8f098f-80c2-4377-a99a-3879445cd020 tempest-CreateVolumesFromImageTest-1347090827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9ed2ebde-dabe-4d59-986a-a1abd6d9d9ca" returned: 0 in 0.706s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8b8f098f-80c2-4377-a99a-3879445cd020 tempest-CreateVolumesFromImageTest-1347090827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9ed2ebde-dabe-4d59-986a-a1abd6d9d9ca {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:55 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9ed2ebde-dabe-4d59-986a-a1abd6d9d9ca Jul 06 15:45:55 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:56 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8b8f098f-80c2-4377-a99a-3879445cd020 tempest-CreateVolumesFromImageTest-1347090827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-9ed2ebde-dabe-4d59-986a-a1abd6d9d9ca" returned: 0 in 0.678s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8b8f098f-80c2-4377-a99a-3879445cd020 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "cinder-quobyte-9ed2ebde-dabe-4d59-986a-a1abd6d9d9ca" released by "delete_volume" :: held 1.422s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:56 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-8b8f098f-80c2-4377-a99a-3879445cd020 tempest-CreateVolumesFromImageTest-1347090827 None] Created reservations ['c423c2e0-bd67-4993-9e97-57a0364fcf6e', 'ddbb49d1-ebab-434c-8596-94e803b995df', '8b444440-863d-4741-a54c-413eb1d67c32', '7389dd04-170f-4662-a180-c4674bbd1c65'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:45:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8b8f098f-80c2-4377-a99a-3879445cd020 tempest-CreateVolumesFromImageTest-1347090827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8b8f098f-80c2-4377-a99a-3879445cd020 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-8b8f098f-80c2-4377-a99a-3879445cd020 tempest-CreateVolumesFromImageTest-1347090827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-8b8f098f-80c2-4377-a99a-3879445cd020 tempest-CreateVolumesFromImageTest-1347090827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8b8f098f-80c2-4377-a99a-3879445cd020 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8b8f098f-80c2-4377-a99a-3879445cd020 tempest-CreateVolumesFromImageTest-1347090827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:56 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:45:56 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:57 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8b8f098f-80c2-4377-a99a-3879445cd020 tempest-CreateVolumesFromImageTest-1347090827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.616s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:57 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-8b8f098f-80c2-4377-a99a-3879445cd020 tempest-CreateVolumesFromImageTest-1347090827 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:45:57 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-8b8f098f-80c2-4377-a99a-3879445cd020 tempest-CreateVolumesFromImageTest-1347090827 None] Deleted volume successfully. Jul 06 15:45:57 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2fa5774d-f512-40c3-87ed-93097594e4ac tempest-CreateVolumesFromImageTest-1347090827 None] Acquiring lock "cinder-81fd1655-9e10-40d9-acdc-3ab6148edce7-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:57 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8b8f098f-80c2-4377-a99a-3879445cd020 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "cinder-9ed2ebde-dabe-4d59-986a-a1abd6d9d9ca-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:57 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2fa5774d-f512-40c3-87ed-93097594e4ac tempest-CreateVolumesFromImageTest-1347090827 None] Lock "cinder-81fd1655-9e10-40d9-acdc-3ab6148edce7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:57 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2fa5774d-f512-40c3-87ed-93097594e4ac tempest-CreateVolumesFromImageTest-1347090827 None] Acquiring lock "cinder-quobyte-81fd1655-9e10-40d9-acdc-3ab6148edce7" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:57 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2fa5774d-f512-40c3-87ed-93097594e4ac tempest-CreateVolumesFromImageTest-1347090827 None] Lock "cinder-quobyte-81fd1655-9e10-40d9-acdc-3ab6148edce7" acquired by "delete_volume" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:57 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[536726c4-df53-4b83-a794-f7014652c21f]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:45:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2fa5774d-f512-40c3-87ed-93097594e4ac tempest-CreateVolumesFromImageTest-1347090827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81fd1655-9e10-40d9-acdc-3ab6148edce7 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:57 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81fd1655-9e10-40d9-acdc-3ab6148edce7 Jul 06 15:45:57 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:58 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2fa5774d-f512-40c3-87ed-93097594e4ac tempest-CreateVolumesFromImageTest-1347090827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81fd1655-9e10-40d9-acdc-3ab6148edce7" returned: 0 in 0.805s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2fa5774d-f512-40c3-87ed-93097594e4ac tempest-CreateVolumesFromImageTest-1347090827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81fd1655-9e10-40d9-acdc-3ab6148edce7 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:58 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81fd1655-9e10-40d9-acdc-3ab6148edce7 Jul 06 15:45:58 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:58 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2fa5774d-f512-40c3-87ed-93097594e4ac tempest-CreateVolumesFromImageTest-1347090827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81fd1655-9e10-40d9-acdc-3ab6148edce7" returned: 0 in 0.615s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:58 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2fa5774d-f512-40c3-87ed-93097594e4ac tempest-CreateVolumesFromImageTest-1347090827 None] Lock "cinder-quobyte-81fd1655-9e10-40d9-acdc-3ab6148edce7" released by "delete_volume" :: held 1.461s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:58 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-2fa5774d-f512-40c3-87ed-93097594e4ac tempest-CreateVolumesFromImageTest-1347090827 None] Created reservations ['5eb95d5f-13f2-4bab-b294-eb792db14608', '8bae968b-13a1-4019-9267-4e4561d4233f', '796eb6e8-053b-4276-b487-01955aff4cfc', '5c13d316-0191-4057-a9f4-08f4a76805ac'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:45:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2fa5774d-f512-40c3-87ed-93097594e4ac tempest-CreateVolumesFromImageTest-1347090827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2fa5774d-f512-40c3-87ed-93097594e4ac tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:59 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2fa5774d-f512-40c3-87ed-93097594e4ac tempest-CreateVolumesFromImageTest-1347090827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:59 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2fa5774d-f512-40c3-87ed-93097594e4ac tempest-CreateVolumesFromImageTest-1347090827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2fa5774d-f512-40c3-87ed-93097594e4ac tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2fa5774d-f512-40c3-87ed-93097594e4ac tempest-CreateVolumesFromImageTest-1347090827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:59 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:45:59 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6b8b1540-c500-4c6b-92bd-aa60d0d5974f tempest-CreateVolumesFromImageTest-1347090827 None] Acquiring lock "cinder-2d75f397-7c06-4aa4-bdbc-b1948fea7ea0-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6b8b1540-c500-4c6b-92bd-aa60d0d5974f tempest-CreateVolumesFromImageTest-1347090827 None] Lock "cinder-2d75f397-7c06-4aa4-bdbc-b1948fea7ea0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6b8b1540-c500-4c6b-92bd-aa60d0d5974f tempest-CreateVolumesFromImageTest-1347090827 None] Acquiring lock "cinder-quobyte-2d75f397-7c06-4aa4-bdbc-b1948fea7ea0" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:59 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2fa5774d-f512-40c3-87ed-93097594e4ac tempest-CreateVolumesFromImageTest-1347090827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.642s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:59 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-2fa5774d-f512-40c3-87ed-93097594e4ac tempest-CreateVolumesFromImageTest-1347090827 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:45:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6b8b1540-c500-4c6b-92bd-aa60d0d5974f tempest-CreateVolumesFromImageTest-1347090827 None] Lock "cinder-quobyte-2d75f397-7c06-4aa4-bdbc-b1948fea7ea0" acquired by "delete_volume" :: waited 0.023s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:59 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-2fa5774d-f512-40c3-87ed-93097594e4ac tempest-CreateVolumesFromImageTest-1347090827 None] Deleted volume successfully. Jul 06 15:45:59 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[d665db22-f209-45b6-a156-6e534a3dc582]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:45:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6b8b1540-c500-4c6b-92bd-aa60d0d5974f tempest-CreateVolumesFromImageTest-1347090827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2d75f397-7c06-4aa4-bdbc-b1948fea7ea0 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2fa5774d-f512-40c3-87ed-93097594e4ac tempest-CreateVolumesFromImageTest-1347090827 None] Lock "cinder-81fd1655-9e10-40d9-acdc-3ab6148edce7-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:59 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2d75f397-7c06-4aa4-bdbc-b1948fea7ea0 Jul 06 15:45:59 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:00 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6b8b1540-c500-4c6b-92bd-aa60d0d5974f tempest-CreateVolumesFromImageTest-1347090827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2d75f397-7c06-4aa4-bdbc-b1948fea7ea0" returned: 0 in 0.716s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6b8b1540-c500-4c6b-92bd-aa60d0d5974f tempest-CreateVolumesFromImageTest-1347090827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2d75f397-7c06-4aa4-bdbc-b1948fea7ea0 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:00 devstack sudo[104204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2d75f397-7c06-4aa4-bdbc-b1948fea7ea0 Jul 06 15:46:00 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:01 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6b8b1540-c500-4c6b-92bd-aa60d0d5974f tempest-CreateVolumesFromImageTest-1347090827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2d75f397-7c06-4aa4-bdbc-b1948fea7ea0" returned: 0 in 0.612s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:01 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6b8b1540-c500-4c6b-92bd-aa60d0d5974f tempest-CreateVolumesFromImageTest-1347090827 None] Lock "cinder-quobyte-2d75f397-7c06-4aa4-bdbc-b1948fea7ea0" released by "delete_volume" :: held 1.368s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:01 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-6b8b1540-c500-4c6b-92bd-aa60d0d5974f tempest-CreateVolumesFromImageTest-1347090827 None] Created reservations ['984c7925-dffa-4b2a-9cf2-664763117e59', '5aa4cabb-9d9a-4f91-8717-3cc55b2681b1', 'f0112667-9a1f-4261-8aab-8add91ea8940', 'c94c67d6-f318-4738-925a-38d480a5bbd3'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:46:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6b8b1540-c500-4c6b-92bd-aa60d0d5974f tempest-CreateVolumesFromImageTest-1347090827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6b8b1540-c500-4c6b-92bd-aa60d0d5974f tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6b8b1540-c500-4c6b-92bd-aa60d0d5974f tempest-CreateVolumesFromImageTest-1347090827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6b8b1540-c500-4c6b-92bd-aa60d0d5974f tempest-CreateVolumesFromImageTest-1347090827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6b8b1540-c500-4c6b-92bd-aa60d0d5974f tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6b8b1540-c500-4c6b-92bd-aa60d0d5974f tempest-CreateVolumesFromImageTest-1347090827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:01 devstack sudo[104207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:46:01 devstack sudo[104207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:01 devstack sudo[104207]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6b8b1540-c500-4c6b-92bd-aa60d0d5974f tempest-CreateVolumesFromImageTest-1347090827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.621s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:01 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-6b8b1540-c500-4c6b-92bd-aa60d0d5974f tempest-CreateVolumesFromImageTest-1347090827 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:46:01 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-6b8b1540-c500-4c6b-92bd-aa60d0d5974f tempest-CreateVolumesFromImageTest-1347090827 None] Deleted volume successfully. Jul 06 15:46:01 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-6b8b1540-c500-4c6b-92bd-aa60d0d5974f tempest-CreateVolumesFromImageTest-1347090827 None] Lock "cinder-2d75f397-7c06-4aa4-bdbc-b1948fea7ea0-delete_volume" released by "delete_volume" :: held 2.198s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:01 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fd21ea4e-494b-4d2e-b6fa-b27310aa9583 tempest-CreateVolumesFromImageTest-1347090827 None] Acquiring lock "cinder-f5917527-f159-42cd-a8ba-a57ce4196b13-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:01 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fd21ea4e-494b-4d2e-b6fa-b27310aa9583 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "cinder-f5917527-f159-42cd-a8ba-a57ce4196b13-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:01 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fd21ea4e-494b-4d2e-b6fa-b27310aa9583 tempest-CreateVolumesFromImageTest-1347090827 None] Acquiring lock "cinder-quobyte-f5917527-f159-42cd-a8ba-a57ce4196b13" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:01 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fd21ea4e-494b-4d2e-b6fa-b27310aa9583 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "cinder-quobyte-f5917527-f159-42cd-a8ba-a57ce4196b13" acquired by "delete_volume" :: waited 0.017s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:01 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adefbba-3148-4fac-86fd-bfd10b140bb2]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fd21ea4e-494b-4d2e-b6fa-b27310aa9583 tempest-CreateVolumesFromImageTest-1347090827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5917527-f159-42cd-a8ba-a57ce4196b13 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:02 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5917527-f159-42cd-a8ba-a57ce4196b13 Jul 06 15:46:02 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:02 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fd21ea4e-494b-4d2e-b6fa-b27310aa9583 tempest-CreateVolumesFromImageTest-1347090827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5917527-f159-42cd-a8ba-a57ce4196b13" returned: 0 in 0.699s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fd21ea4e-494b-4d2e-b6fa-b27310aa9583 tempest-CreateVolumesFromImageTest-1347090827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5917527-f159-42cd-a8ba-a57ce4196b13 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:02 devstack sudo[104215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5917527-f159-42cd-a8ba-a57ce4196b13 Jul 06 15:46:02 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:03 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fd21ea4e-494b-4d2e-b6fa-b27310aa9583 tempest-CreateVolumesFromImageTest-1347090827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-f5917527-f159-42cd-a8ba-a57ce4196b13" returned: 0 in 0.611s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:03 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fd21ea4e-494b-4d2e-b6fa-b27310aa9583 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "cinder-quobyte-f5917527-f159-42cd-a8ba-a57ce4196b13" released by "delete_volume" :: held 1.349s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:03 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-fd21ea4e-494b-4d2e-b6fa-b27310aa9583 tempest-CreateVolumesFromImageTest-1347090827 None] Created reservations ['269a2a62-0aee-4df0-98ed-e9f4823fdcb9', '463b02ce-1ff1-4915-a37a-d0dd17672ed1', '56bdf654-015a-4eaa-b0d8-c8d7a55a065e', 'a8380fc1-6953-478c-ba60-c143e9e9be23'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:46:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fd21ea4e-494b-4d2e-b6fa-b27310aa9583 tempest-CreateVolumesFromImageTest-1347090827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fd21ea4e-494b-4d2e-b6fa-b27310aa9583 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:03 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fd21ea4e-494b-4d2e-b6fa-b27310aa9583 tempest-CreateVolumesFromImageTest-1347090827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:03 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fd21ea4e-494b-4d2e-b6fa-b27310aa9583 tempest-CreateVolumesFromImageTest-1347090827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fd21ea4e-494b-4d2e-b6fa-b27310aa9583 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fd21ea4e-494b-4d2e-b6fa-b27310aa9583 tempest-CreateVolumesFromImageTest-1347090827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:03 devstack sudo[104218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:46:03 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:04 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fd21ea4e-494b-4d2e-b6fa-b27310aa9583 tempest-CreateVolumesFromImageTest-1347090827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.644s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:04 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-fd21ea4e-494b-4d2e-b6fa-b27310aa9583 tempest-CreateVolumesFromImageTest-1347090827 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:46:04 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-fd21ea4e-494b-4d2e-b6fa-b27310aa9583 tempest-CreateVolumesFromImageTest-1347090827 None] Deleted volume successfully. Jul 06 15:46:04 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-fd21ea4e-494b-4d2e-b6fa-b27310aa9583 tempest-CreateVolumesFromImageTest-1347090827 None] Lock "cinder-f5917527-f159-42cd-a8ba-a57ce4196b13-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:06 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:46:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Flow 'volume_create_manager' (941cb74d-dfa8-4a85-8ded-f2d01fdb3f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0bd3eed-ef8b-47a2-9614-5d3ca3414901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0bd3eed-ef8b-47a2-9614-5d3ca3414901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-835726192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6783f04-5257-49a3-a3a9-77cffce57486,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e523d6c14c4044ac4131b2fa02e817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:07Z,use_quota=True,user_id='aaded05256474ae8bf4b205c0f0ea64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9adddfcb-2106-481b-8263-edc0a8ffb6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9adddfcb-2106-481b-8263-edc0a8ffb6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fec14a24-9fbe-4fe6-a054-5fa290734e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fec14a24-9fbe-4fe6-a054-5fa290734e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6783f04-5257-49a3-a3a9-77cffce57486', 'volume_name': 'volume-d6783f04-5257-49a3-a3a9-77cffce57486', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c87c75f1-62fd-477e-8312-5fe434519df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c87c75f1-62fd-477e-8312-5fe434519df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a899a8a8-3c9e-4bca-a5d7-9e5bdbfde641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:07 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Volume d6783f04-5257-49a3-a3a9-77cffce57486: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6783f04-5257-49a3-a3a9-77cffce57486', 'volume_size': 1} Jul 06 15:46:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-835726192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6783f04-5257-49a3-a3a9-77cffce57486,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e523d6c14c4044ac4131b2fa02e817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:07Z,use_quota=True,user_id='aaded05256474ae8bf4b205c0f0ea64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:46:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Creating volume d6783f04-5257-49a3-a3a9-77cffce57486 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:46:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:46:07 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:46:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:07 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486 1073741824 Jul 06 15:46:07 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:07 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486 1073741824" returned: 0 in 0.776s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:07 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486 Jul 06 15:46:07 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:08 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486" returned: 0 in 0.610s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:46:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a899a8a8-3c9e-4bca-a5d7-9e5bdbfde641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6783f04-5257-49a3-a3a9-77cffce57486', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2191f0b6-223e-40b5-8998-609fdc32f135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:08 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Volume volume-d6783f04-5257-49a3-a3a9-77cffce57486 (d6783f04-5257-49a3-a3a9-77cffce57486): created successfully Jul 06 15:46:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2191f0b6-223e-40b5-8998-609fdc32f135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:08 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Flow 'volume_create_manager' (941cb74d-dfa8-4a85-8ded-f2d01fdb3f2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:08 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-c9c6b081-86eb-488b-a0ec-673c6a4cd18b tempest-VolumeDependencyTests-954216851 None] Created volume successfully. Jul 06 15:46:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-cd716d14-3754-4a40-892a-ea22f2f296c9 tempest-VolumeDependencyTests-954216851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-cd716d14-3754-4a40-892a-ea22f2f296c9 tempest-VolumeDependencyTests-954216851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-cd716d14-3754-4a40-892a-ea22f2f296c9 tempest-VolumeDependencyTests-954216851 None] Creating offline snapshot dc2ce502-58f3-4195-b45f-f5a581d808e0 of volume d6783f04-5257-49a3-a3a9-77cffce57486 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:46:09 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5408f1-5528-4feb-bbc2-94eb183f29af]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cd716d14-3754-4a40-892a-ea22f2f296c9 tempest-VolumeDependencyTests-954216851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:09 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486 Jul 06 15:46:09 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:09 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cd716d14-3754-4a40-892a-ea22f2f296c9 tempest-VolumeDependencyTests-954216851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486" returned: 0 in 0.773s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cd716d14-3754-4a40-892a-ea22f2f296c9 tempest-VolumeDependencyTests-954216851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.dc2ce502-58f3-4195-b45f-f5a581d808e0 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:10 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.dc2ce502-58f3-4195-b45f-f5a581d808e0 1G Jul 06 15:46:10 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:10 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cd716d14-3754-4a40-892a-ea22f2f296c9 tempest-VolumeDependencyTests-954216851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.dc2ce502-58f3-4195-b45f-f5a581d808e0 1G" returned: 0 in 0.739s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cd716d14-3754-4a40-892a-ea22f2f296c9 tempest-VolumeDependencyTests-954216851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6783f04-5257-49a3-a3a9-77cffce57486 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.dc2ce502-58f3-4195-b45f-f5a581d808e0 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:10 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6783f04-5257-49a3-a3a9-77cffce57486 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.dc2ce502-58f3-4195-b45f-f5a581d808e0 Jul 06 15:46:10 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:11 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cd716d14-3754-4a40-892a-ea22f2f296c9 tempest-VolumeDependencyTests-954216851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6783f04-5257-49a3-a3a9-77cffce57486 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.dc2ce502-58f3-4195-b45f-f5a581d808e0" returned: 0 in 0.678s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:11 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-cd716d14-3754-4a40-892a-ea22f2f296c9 tempest-VolumeDependencyTests-954216851 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.dc2ce502-58f3-4195-b45f-f5a581d808e0 is being set with open permissions: ugo+rw Jul 06 15:46:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cd716d14-3754-4a40-892a-ea22f2f296c9 tempest-VolumeDependencyTests-954216851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.dc2ce502-58f3-4195-b45f-f5a581d808e0 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:11 devstack sudo[104249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.dc2ce502-58f3-4195-b45f-f5a581d808e0 Jul 06 15:46:11 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:12 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cd716d14-3754-4a40-892a-ea22f2f296c9 tempest-VolumeDependencyTests-954216851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.dc2ce502-58f3-4195-b45f-f5a581d808e0" returned: 0 in 0.618s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cd716d14-3754-4a40-892a-ea22f2f296c9 tempest-VolumeDependencyTests-954216851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:12 devstack sudo[104252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.info Jul 06 15:46:12 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:12 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cd716d14-3754-4a40-892a-ea22f2f296c9 tempest-VolumeDependencyTests-954216851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.info" returned: 0 in 0.623s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:12 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-cd716d14-3754-4a40-892a-ea22f2f296c9 tempest-VolumeDependencyTests-954216851 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.info is being set with open permissions: ugo+rw Jul 06 15:46:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cd716d14-3754-4a40-892a-ea22f2f296c9 tempest-VolumeDependencyTests-954216851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:12 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.info Jul 06 15:46:12 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:13 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cd716d14-3754-4a40-892a-ea22f2f296c9 tempest-VolumeDependencyTests-954216851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.info" returned: 0 in 0.596s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-cd716d14-3754-4a40-892a-ea22f2f296c9 tempest-VolumeDependencyTests-954216851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.112s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:13 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-cd716d14-3754-4a40-892a-ea22f2f296c9 tempest-VolumeDependencyTests-954216851 None] Create snapshot completed successfully Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Flow 'volume_create_manager' (ea4bd255-8746-496d-91b7-6cd433af7917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034fdea8-c12d-42ca-b8a6-2783725f65e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034fdea8-c12d-42ca-b8a6-2783725f65e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-789111963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fad6b2a-72c4-450d-a7ac-52d61a2bde30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e523d6c14c4044ac4131b2fa02e817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dc2ce502-58f3-4195-b45f-f5a581d808e0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:15Z,use_quota=True,user_id='aaded05256474ae8bf4b205c0f0ea64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cace14c2-4b88-4578-a1ff-f4a75c352357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cace14c2-4b88-4578-a1ff-f4a75c352357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (809b12a7-e087-4108-b57b-7d4ddbcceff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (809b12a7-e087-4108-b57b-7d4ddbcceff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2fad6b2a-72c4-450d-a7ac-52d61a2bde30', 'volume_name': 'volume-2fad6b2a-72c4-450d-a7ac-52d61a2bde30', 'volume_size': 1, 'snapshot_id': 'dc2ce502-58f3-4195-b45f-f5a581d808e0'}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47fe7b87-71ae-4493-938d-975b5418e247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47fe7b87-71ae-4493-938d-975b5418e247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f93ab0f-c8f7-489e-9798-bfb3cc78549b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:14 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Volume 2fad6b2a-72c4-450d-a7ac-52d61a2bde30: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2fad6b2a-72c4-450d-a7ac-52d61a2bde30', 'volume_size': 1, 'snapshot_id': 'dc2ce502-58f3-4195-b45f-f5a581d808e0'} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Acquiring lock "cinder-quobyte-dc2ce502-58f3-4195-b45f-f5a581d808e0-2fad6b2a-72c4-450d-a7ac-52d61a2bde30" by "_create_volume_from_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Lock "cinder-quobyte-dc2ce502-58f3-4195-b45f-f5a581d808e0-2fad6b2a-72c4-450d-a7ac-52d61a2bde30" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Creating volume 2fad6b2a-72c4-450d-a7ac-52d61a2bde30 from snapshot dc2ce502-58f3-4195-b45f-f5a581d808e0 {{(pid=86148) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Acquiring lock "cinder-quobyte-2fad6b2a-72c4-450d-a7ac-52d61a2bde30" by "_copy_volume_from_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Lock "cinder-quobyte-2fad6b2a-72c4-450d-a7ac-52d61a2bde30" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] snapshot: dc2ce502-58f3-4195-b45f-f5a581d808e0, volume: 2fad6b2a-72c4-450d-a7ac-52d61a2bde30, {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:15 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a56a4e-d4f0-4179-bd9b-082f4f29a223]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.dc2ce502-58f3-4195-b45f-f5a581d808e0 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:15 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.dc2ce502-58f3-4195-b45f-f5a581d808e0 Jul 06 15:46:15 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:15 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.dc2ce502-58f3-4195-b45f-f5a581d808e0" returned: 0 in 0.722s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:15 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6783f04-5257-49a3-a3a9-77cffce57486(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:46:15 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486 {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 15:46:15 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Creating direct copy from snapshot {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 15:46:15 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1bacd2-3f26-417a-beb1-ee087755aa13]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:15 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486 Jul 06 15:46:15 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:16 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486" returned: 0 in 0.737s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:16 devstack cinder-volume[86148]: DEBUG cinder.utils [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Path /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2fad6b2a-72c4-450d-a7ac-52d61a2bde30 not found in is_blk_device check {{(pid=86148) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 15:46:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2fad6b2a-72c4-450d-a7ac-52d61a2bde30 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:16 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2fad6b2a-72c4-450d-a7ac-52d61a2bde30 Jul 06 15:46:16 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:20 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2fad6b2a-72c4-450d-a7ac-52d61a2bde30" returned: 0 in 4.354s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:20 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[470802a6-70cf-44c2-924b-07cd6a5fd7e5]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:20 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486 Jul 06 15:46:20 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:21 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486" returned: 0 in 0.935s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:21 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486, size 1024.00 MB, duration 4.36 sec, destination /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2fad6b2a-72c4-450d-a7ac-52d61a2bde30 {{(pid=86148) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:46:21 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Converted 1024.00 MB image at 235.12 MB/s Jul 06 15:46:21 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2fad6b2a-72c4-450d-a7ac-52d61a2bde30 is being set with open permissions: ugo+rw Jul 06 15:46:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2fad6b2a-72c4-450d-a7ac-52d61a2bde30 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:21 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2fad6b2a-72c4-450d-a7ac-52d61a2bde30 Jul 06 15:46:21 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:22 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2fad6b2a-72c4-450d-a7ac-52d61a2bde30" returned: 0 in 0.603s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:22 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Lock "cinder-quobyte-2fad6b2a-72c4-450d-a7ac-52d61a2bde30" released by "_copy_volume_from_snapshot" :: held 7.433s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:22 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Lock "cinder-quobyte-dc2ce502-58f3-4195-b45f-f5a581d808e0-2fad6b2a-72c4-450d-a7ac-52d61a2bde30" released by "_create_volume_from_snapshot" :: held 7.460s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.474s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f93ab0f-c8f7-489e-9798-bfb3cc78549b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fad6b2a-72c4-450d-a7ac-52d61a2bde30', 'volume_size': 1, 'snapshot_id': 'dc2ce502-58f3-4195-b45f-f5a581d808e0'}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f141c28-2f4b-47f5-b664-0f7066bfd900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:22 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Volume volume-2fad6b2a-72c4-450d-a7ac-52d61a2bde30 (2fad6b2a-72c4-450d-a7ac-52d61a2bde30): created successfully Jul 06 15:46:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f141c28-2f4b-47f5-b664-0f7066bfd900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Flow 'volume_create_manager' (ea4bd255-8746-496d-91b7-6cd433af7917) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:22 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-597a86da-c864-40fa-9ade-68008bcf94f6 tempest-VolumeDependencyTests-954216851 None] Created volume successfully. Jul 06 15:46:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dde199c2-db52-4290-883a-9de219532bcc tempest-VolumeDependencyTests-954216851 None] Acquiring lock "cinder-dc2ce502-58f3-4195-b45f-f5a581d808e0-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dde199c2-db52-4290-883a-9de219532bcc tempest-VolumeDependencyTests-954216851 None] Lock "cinder-dc2ce502-58f3-4195-b45f-f5a581d808e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dde199c2-db52-4290-883a-9de219532bcc tempest-VolumeDependencyTests-954216851 None] Acquiring lock "cinder-quobyte-d6783f04-5257-49a3-a3a9-77cffce57486" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dde199c2-db52-4290-883a-9de219532bcc tempest-VolumeDependencyTests-954216851 None] Lock "cinder-quobyte-d6783f04-5257-49a3-a3a9-77cffce57486" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dde199c2-db52-4290-883a-9de219532bcc tempest-VolumeDependencyTests-954216851 None] Acquiring lock "cinder-quobyte-dc2ce502-58f3-4195-b45f-f5a581d808e0" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dde199c2-db52-4290-883a-9de219532bcc tempest-VolumeDependencyTests-954216851 None] Lock "cinder-quobyte-dc2ce502-58f3-4195-b45f-f5a581d808e0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-dde199c2-db52-4290-883a-9de219532bcc tempest-VolumeDependencyTests-954216851 None] Deleting offline snapshot dc2ce502-58f3-4195-b45f-f5a581d808e0 of volume d6783f04-5257-49a3-a3a9-77cffce57486 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:46:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-dde199c2-db52-4290-883a-9de219532bcc tempest-VolumeDependencyTests-954216851 None] snapshot_file for this snap is: volume-d6783f04-5257-49a3-a3a9-77cffce57486.dc2ce502-58f3-4195-b45f-f5a581d808e0 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:46:23 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[6360a696-31b5-41aa-a857-89975aecad74]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dde199c2-db52-4290-883a-9de219532bcc tempest-VolumeDependencyTests-954216851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.dc2ce502-58f3-4195-b45f-f5a581d808e0 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:23 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.dc2ce502-58f3-4195-b45f-f5a581d808e0 Jul 06 15:46:23 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:24 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dde199c2-db52-4290-883a-9de219532bcc tempest-VolumeDependencyTests-954216851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.dc2ce502-58f3-4195-b45f-f5a581d808e0" returned: 0 in 0.769s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-dde199c2-db52-4290-883a-9de219532bcc tempest-VolumeDependencyTests-954216851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6783f04-5257-49a3-a3a9-77cffce57486(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:46:24 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[62067e66-c319-4910-bf58-857a6a610d69]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dde199c2-db52-4290-883a-9de219532bcc tempest-VolumeDependencyTests-954216851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:24 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486 Jul 06 15:46:24 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:25 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dde199c2-db52-4290-883a-9de219532bcc tempest-VolumeDependencyTests-954216851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486" returned: 0 in 0.751s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dde199c2-db52-4290-883a-9de219532bcc tempest-VolumeDependencyTests-954216851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.dc2ce502-58f3-4195-b45f-f5a581d808e0 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:25 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.dc2ce502-58f3-4195-b45f-f5a581d808e0 Jul 06 15:46:25 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:25 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dde199c2-db52-4290-883a-9de219532bcc tempest-VolumeDependencyTests-954216851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.dc2ce502-58f3-4195-b45f-f5a581d808e0" returned: 0 in 0.731s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dde199c2-db52-4290-883a-9de219532bcc tempest-VolumeDependencyTests-954216851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.dc2ce502-58f3-4195-b45f-f5a581d808e0 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:25 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.dc2ce502-58f3-4195-b45f-f5a581d808e0 Jul 06 15:46:25 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:26 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dde199c2-db52-4290-883a-9de219532bcc tempest-VolumeDependencyTests-954216851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486.dc2ce502-58f3-4195-b45f-f5a581d808e0" returned: 0 in 0.628s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dde199c2-db52-4290-883a-9de219532bcc tempest-VolumeDependencyTests-954216851 None] Lock "cinder-quobyte-dc2ce502-58f3-4195-b45f-f5a581d808e0" released by "_delete_snapshot" :: held 2.967s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dde199c2-db52-4290-883a-9de219532bcc tempest-VolumeDependencyTests-954216851 None] Lock "cinder-quobyte-d6783f04-5257-49a3-a3a9-77cffce57486" released by "delete_snapshot" :: held 2.989s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:26 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-dde199c2-db52-4290-883a-9de219532bcc tempest-VolumeDependencyTests-954216851 None] Created reservations ['248a80d2-2368-40c9-9b1d-60136fa43ae8', '6b4a9856-c4b6-422a-aff0-48cec00e11a3', '142393b2-6631-4fb1-867f-c162da3065ad', 'dedc86e5-1a5e-4cbe-9c27-acd72701e521'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:46:26 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-dde199c2-db52-4290-883a-9de219532bcc tempest-VolumeDependencyTests-954216851 None] Delete snapshot completed successfully. Jul 06 15:46:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dde199c2-db52-4290-883a-9de219532bcc tempest-VolumeDependencyTests-954216851 None] Lock "cinder-dc2ce502-58f3-4195-b45f-f5a581d808e0-delete_snapshot" released by "delete_snapshot" :: held 3.135s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f196057a-6717-4ec5-984d-ad1dd847ac2b tempest-VolumeDependencyTests-954216851 None] Acquiring lock "cinder-d6783f04-5257-49a3-a3a9-77cffce57486-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f196057a-6717-4ec5-984d-ad1dd847ac2b tempest-VolumeDependencyTests-954216851 None] Lock "cinder-d6783f04-5257-49a3-a3a9-77cffce57486-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f196057a-6717-4ec5-984d-ad1dd847ac2b tempest-VolumeDependencyTests-954216851 None] Acquiring lock "cinder-quobyte-d6783f04-5257-49a3-a3a9-77cffce57486" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f196057a-6717-4ec5-984d-ad1dd847ac2b tempest-VolumeDependencyTests-954216851 None] Lock "cinder-quobyte-d6783f04-5257-49a3-a3a9-77cffce57486" acquired by "delete_volume" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:26 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[5957b433-b1ec-4779-bfa7-230558753539]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f196057a-6717-4ec5-984d-ad1dd847ac2b tempest-VolumeDependencyTests-954216851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:26 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486 Jul 06 15:46:26 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:27 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f196057a-6717-4ec5-984d-ad1dd847ac2b tempest-VolumeDependencyTests-954216851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486" returned: 0 in 0.721s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f196057a-6717-4ec5-984d-ad1dd847ac2b tempest-VolumeDependencyTests-954216851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:27 devstack sudo[104315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486 Jul 06 15:46:27 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:28 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f196057a-6717-4ec5-984d-ad1dd847ac2b tempest-VolumeDependencyTests-954216851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6783f04-5257-49a3-a3a9-77cffce57486" returned: 0 in 0.614s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:28 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f196057a-6717-4ec5-984d-ad1dd847ac2b tempest-VolumeDependencyTests-954216851 None] Lock "cinder-quobyte-d6783f04-5257-49a3-a3a9-77cffce57486" released by "delete_volume" :: held 1.388s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:28 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-f196057a-6717-4ec5-984d-ad1dd847ac2b tempest-VolumeDependencyTests-954216851 None] Created reservations ['aa22b8ae-6279-4070-84b3-4833c057ef82', '315fd502-d467-4496-bf37-ecec52e8a4a1', '126aba9e-9924-4e44-bc27-63090bfe553d', '520c528a-05bb-47cc-8ed2-cb23af11e237'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:46:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f196057a-6717-4ec5-984d-ad1dd847ac2b tempest-VolumeDependencyTests-954216851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f196057a-6717-4ec5-984d-ad1dd847ac2b tempest-VolumeDependencyTests-954216851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:28 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f196057a-6717-4ec5-984d-ad1dd847ac2b tempest-VolumeDependencyTests-954216851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:28 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f196057a-6717-4ec5-984d-ad1dd847ac2b tempest-VolumeDependencyTests-954216851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f196057a-6717-4ec5-984d-ad1dd847ac2b tempest-VolumeDependencyTests-954216851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f196057a-6717-4ec5-984d-ad1dd847ac2b tempest-VolumeDependencyTests-954216851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:28 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:46:28 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:28 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f196057a-6717-4ec5-984d-ad1dd847ac2b tempest-VolumeDependencyTests-954216851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.644s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:28 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-f196057a-6717-4ec5-984d-ad1dd847ac2b tempest-VolumeDependencyTests-954216851 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:46:28 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-f196057a-6717-4ec5-984d-ad1dd847ac2b tempest-VolumeDependencyTests-954216851 None] Deleted volume successfully. Jul 06 15:46:28 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=63,cinder:UPDATE=81,cinder:INSERT=20,cinder:DELETE=4 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:46:28 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-550237ef-ead6-41e5-9d50-7b35cc483424 tempest-VolumeDependencyTests-954216851 None] Acquiring lock "cinder-2fad6b2a-72c4-450d-a7ac-52d61a2bde30-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:28 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f196057a-6717-4ec5-984d-ad1dd847ac2b tempest-VolumeDependencyTests-954216851 None] Lock "cinder-d6783f04-5257-49a3-a3a9-77cffce57486-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:28 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-550237ef-ead6-41e5-9d50-7b35cc483424 tempest-VolumeDependencyTests-954216851 None] Lock "cinder-2fad6b2a-72c4-450d-a7ac-52d61a2bde30-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-550237ef-ead6-41e5-9d50-7b35cc483424 tempest-VolumeDependencyTests-954216851 None] Acquiring lock "cinder-quobyte-2fad6b2a-72c4-450d-a7ac-52d61a2bde30" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-550237ef-ead6-41e5-9d50-7b35cc483424 tempest-VolumeDependencyTests-954216851 None] Lock "cinder-quobyte-2fad6b2a-72c4-450d-a7ac-52d61a2bde30" acquired by "delete_volume" :: waited 0.013s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:29 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7295f88-57d6-4737-a9d9-5f67ad4cb2d2]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-550237ef-ead6-41e5-9d50-7b35cc483424 tempest-VolumeDependencyTests-954216851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2fad6b2a-72c4-450d-a7ac-52d61a2bde30 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:29 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2fad6b2a-72c4-450d-a7ac-52d61a2bde30 Jul 06 15:46:29 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:29 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-550237ef-ead6-41e5-9d50-7b35cc483424 tempest-VolumeDependencyTests-954216851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2fad6b2a-72c4-450d-a7ac-52d61a2bde30" returned: 0 in 0.727s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-550237ef-ead6-41e5-9d50-7b35cc483424 tempest-VolumeDependencyTests-954216851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2fad6b2a-72c4-450d-a7ac-52d61a2bde30 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:29 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2fad6b2a-72c4-450d-a7ac-52d61a2bde30 Jul 06 15:46:29 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:30 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-550237ef-ead6-41e5-9d50-7b35cc483424 tempest-VolumeDependencyTests-954216851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2fad6b2a-72c4-450d-a7ac-52d61a2bde30" returned: 0 in 0.649s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:30 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-550237ef-ead6-41e5-9d50-7b35cc483424 tempest-VolumeDependencyTests-954216851 None] Lock "cinder-quobyte-2fad6b2a-72c4-450d-a7ac-52d61a2bde30" released by "delete_volume" :: held 1.419s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:30 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-550237ef-ead6-41e5-9d50-7b35cc483424 tempest-VolumeDependencyTests-954216851 None] Created reservations ['0a8dd1cd-c88c-49ee-9d78-28ea2be3b429', 'ab4ad2a7-76de-4738-a818-8860e9b3479f', 'd63cc418-3f4c-425e-b776-d9b942a9d11a', 'c7c9a10e-5257-411d-839e-45417e853d64'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:46:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-550237ef-ead6-41e5-9d50-7b35cc483424 tempest-VolumeDependencyTests-954216851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-550237ef-ead6-41e5-9d50-7b35cc483424 tempest-VolumeDependencyTests-954216851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-550237ef-ead6-41e5-9d50-7b35cc483424 tempest-VolumeDependencyTests-954216851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-550237ef-ead6-41e5-9d50-7b35cc483424 tempest-VolumeDependencyTests-954216851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-550237ef-ead6-41e5-9d50-7b35cc483424 tempest-VolumeDependencyTests-954216851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-550237ef-ead6-41e5-9d50-7b35cc483424 tempest-VolumeDependencyTests-954216851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:30 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:46:30 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:31 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-550237ef-ead6-41e5-9d50-7b35cc483424 tempest-VolumeDependencyTests-954216851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.619s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:31 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-550237ef-ead6-41e5-9d50-7b35cc483424 tempest-VolumeDependencyTests-954216851 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:46:31 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-550237ef-ead6-41e5-9d50-7b35cc483424 tempest-VolumeDependencyTests-954216851 None] Deleted volume successfully. Jul 06 15:46:31 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-550237ef-ead6-41e5-9d50-7b35cc483424 tempest-VolumeDependencyTests-954216851 None] Lock "cinder-2fad6b2a-72c4-450d-a7ac-52d61a2bde30-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:34 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:46:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Flow 'volume_create_manager' (44820793-79af-4792-96d0-44b56148ca6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b368634-9190-467b-8af6-5fa9be459a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b368634-9190-467b-8af6-5fa9be459a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1144181340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51aa572-06a1-4178-aba9-6f5ef6f99765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a528b44221349e5acfc9452cbeeaeec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:34Z,use_quota=True,user_id='120a2aba9d8848dcb65a0a5513422d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d1fc6b6-9120-4611-99cd-5ea086fbb99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d1fc6b6-9120-4611-99cd-5ea086fbb99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2f38d4a-902b-49d9-9c77-c46fcad45a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2f38d4a-902b-49d9-9c77-c46fcad45a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c51aa572-06a1-4178-aba9-6f5ef6f99765', 'volume_name': 'volume-c51aa572-06a1-4178-aba9-6f5ef6f99765', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8612baf8-379d-4876-8edf-c109dc1a1f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8612baf8-379d-4876-8edf-c109dc1a1f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269156b5-abd3-471d-a1fc-0e77bc5ded83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:34 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Volume c51aa572-06a1-4178-aba9-6f5ef6f99765: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c51aa572-06a1-4178-aba9-6f5ef6f99765', 'volume_size': 1} Jul 06 15:46:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1144181340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51aa572-06a1-4178-aba9-6f5ef6f99765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a528b44221349e5acfc9452cbeeaeec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:34Z,use_quota=True,user_id='120a2aba9d8848dcb65a0a5513422d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:46:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Creating volume c51aa572-06a1-4178-aba9-6f5ef6f99765 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:46:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:46:34 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:46:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c51aa572-06a1-4178-aba9-6f5ef6f99765 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:34 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c51aa572-06a1-4178-aba9-6f5ef6f99765 1073741824 Jul 06 15:46:34 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:35 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c51aa572-06a1-4178-aba9-6f5ef6f99765 1073741824" returned: 0 in 0.754s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c51aa572-06a1-4178-aba9-6f5ef6f99765 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:35 devstack sudo[104343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c51aa572-06a1-4178-aba9-6f5ef6f99765 Jul 06 15:46:35 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:35 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c51aa572-06a1-4178-aba9-6f5ef6f99765" returned: 0 in 0.600s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:35 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:46:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269156b5-abd3-471d-a1fc-0e77bc5ded83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c51aa572-06a1-4178-aba9-6f5ef6f99765', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed0bb8b-4713-49bc-9bd0-bae2c3b97ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:35 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Volume volume-c51aa572-06a1-4178-aba9-6f5ef6f99765 (c51aa572-06a1-4178-aba9-6f5ef6f99765): created successfully Jul 06 15:46:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed0bb8b-4713-49bc-9bd0-bae2c3b97ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Flow 'volume_create_manager' (44820793-79af-4792-96d0-44b56148ca6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:35 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-c8af6c33-7ebc-441f-a388-4926d68941d9 tempest-ProjectReaderTests-1083527420 None] Created volume successfully. Jul 06 15:46:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c83ea0bc-0c9b-4b2e-8eef-80e3fbc15ad5 tempest-ProjectReaderTests-1083527420 None] Acquiring lock "cinder-c51aa572-06a1-4178-aba9-6f5ef6f99765-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c83ea0bc-0c9b-4b2e-8eef-80e3fbc15ad5 tempest-ProjectReaderTests-1083527420 None] Lock "cinder-c51aa572-06a1-4178-aba9-6f5ef6f99765-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c83ea0bc-0c9b-4b2e-8eef-80e3fbc15ad5 tempest-ProjectReaderTests-1083527420 None] Acquiring lock "cinder-quobyte-c51aa572-06a1-4178-aba9-6f5ef6f99765" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c83ea0bc-0c9b-4b2e-8eef-80e3fbc15ad5 tempest-ProjectReaderTests-1083527420 None] Lock "cinder-quobyte-c51aa572-06a1-4178-aba9-6f5ef6f99765" acquired by "delete_volume" :: waited 0.013s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:36 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[680c2da3-2cdf-4d54-b428-523f27ac790d]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c83ea0bc-0c9b-4b2e-8eef-80e3fbc15ad5 tempest-ProjectReaderTests-1083527420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c51aa572-06a1-4178-aba9-6f5ef6f99765 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:36 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c51aa572-06a1-4178-aba9-6f5ef6f99765 Jul 06 15:46:36 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:37 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c83ea0bc-0c9b-4b2e-8eef-80e3fbc15ad5 tempest-ProjectReaderTests-1083527420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c51aa572-06a1-4178-aba9-6f5ef6f99765" returned: 0 in 0.706s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c83ea0bc-0c9b-4b2e-8eef-80e3fbc15ad5 tempest-ProjectReaderTests-1083527420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c51aa572-06a1-4178-aba9-6f5ef6f99765 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:37 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c51aa572-06a1-4178-aba9-6f5ef6f99765 Jul 06 15:46:37 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:38 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c83ea0bc-0c9b-4b2e-8eef-80e3fbc15ad5 tempest-ProjectReaderTests-1083527420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c51aa572-06a1-4178-aba9-6f5ef6f99765" returned: 0 in 0.618s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c83ea0bc-0c9b-4b2e-8eef-80e3fbc15ad5 tempest-ProjectReaderTests-1083527420 None] Lock "cinder-quobyte-c51aa572-06a1-4178-aba9-6f5ef6f99765" released by "delete_volume" :: held 1.359s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:38 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-c83ea0bc-0c9b-4b2e-8eef-80e3fbc15ad5 tempest-ProjectReaderTests-1083527420 None] Created reservations ['d6bf195c-ec89-40e7-bab5-2e3cba22eacb', '971c7420-5b70-4aaa-a096-56171316b15a', '5394c6ed-c063-4a0a-8474-237fa11ca0cf', 'e398c896-02f4-4219-a1f0-e7aadcb25073'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:46:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c83ea0bc-0c9b-4b2e-8eef-80e3fbc15ad5 tempest-ProjectReaderTests-1083527420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c83ea0bc-0c9b-4b2e-8eef-80e3fbc15ad5 tempest-ProjectReaderTests-1083527420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c83ea0bc-0c9b-4b2e-8eef-80e3fbc15ad5 tempest-ProjectReaderTests-1083527420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c83ea0bc-0c9b-4b2e-8eef-80e3fbc15ad5 tempest-ProjectReaderTests-1083527420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c83ea0bc-0c9b-4b2e-8eef-80e3fbc15ad5 tempest-ProjectReaderTests-1083527420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c83ea0bc-0c9b-4b2e-8eef-80e3fbc15ad5 tempest-ProjectReaderTests-1083527420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:38 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:46:38 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:46:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:38 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:46:38 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:38 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c83ea0bc-0c9b-4b2e-8eef-80e3fbc15ad5 tempest-ProjectReaderTests-1083527420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.627s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:38 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-c83ea0bc-0c9b-4b2e-8eef-80e3fbc15ad5 tempest-ProjectReaderTests-1083527420 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:46:38 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-c83ea0bc-0c9b-4b2e-8eef-80e3fbc15ad5 tempest-ProjectReaderTests-1083527420 None] Deleted volume successfully. Jul 06 15:46:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c83ea0bc-0c9b-4b2e-8eef-80e3fbc15ad5 tempest-ProjectReaderTests-1083527420 None] Lock "cinder-c51aa572-06a1-4178-aba9-6f5ef6f99765-delete_volume" released by "delete_volume" :: held 2.190s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:39 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.660s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:46:39 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager._thread_info {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:46:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread count: 28 {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:46:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread info: [<_MainThread(MainThread, started 124857273856128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:46:39 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:46:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Flow 'volume_create_manager' (d0b0db9d-38ff-46a2-8e3b-e8a8b9741280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544cb51a-b737-4875-9010-c8ddba9a148e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544cb51a-b737-4875-9010-c8ddba9a148e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1529693484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419b277c-16e6-4dfc-8a9d-209ebe6f166b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a528b44221349e5acfc9452cbeeaeec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:39Z,use_quota=True,user_id='120a2aba9d8848dcb65a0a5513422d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (101e9432-8238-4ecc-bc91-d956a4d70ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (101e9432-8238-4ecc-bc91-d956a4d70ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84664557-b0ec-49be-9f23-7aed15e8c5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84664557-b0ec-49be-9f23-7aed15e8c5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '419b277c-16e6-4dfc-8a9d-209ebe6f166b', 'volume_name': 'volume-419b277c-16e6-4dfc-8a9d-209ebe6f166b', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c4790f8-e740-49cd-a0d1-0824587ed928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c4790f8-e740-49cd-a0d1-0824587ed928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb32957-b4bf-41d2-b70c-5105b830b881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:39 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Volume 419b277c-16e6-4dfc-8a9d-209ebe6f166b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-419b277c-16e6-4dfc-8a9d-209ebe6f166b', 'volume_size': 1} Jul 06 15:46:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:39 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1529693484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419b277c-16e6-4dfc-8a9d-209ebe6f166b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a528b44221349e5acfc9452cbeeaeec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:39Z,use_quota=True,user_id='120a2aba9d8848dcb65a0a5513422d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:46:39 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Creating volume 419b277c-16e6-4dfc-8a9d-209ebe6f166b {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:46:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:39 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:39 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:39 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:46:39 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:46:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-419b277c-16e6-4dfc-8a9d-209ebe6f166b 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:39 devstack sudo[104363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-419b277c-16e6-4dfc-8a9d-209ebe6f166b 1073741824 Jul 06 15:46:39 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:40 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-419b277c-16e6-4dfc-8a9d-209ebe6f166b 1073741824" returned: 0 in 0.787s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-419b277c-16e6-4dfc-8a9d-209ebe6f166b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:40 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-419b277c-16e6-4dfc-8a9d-209ebe6f166b Jul 06 15:46:40 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:40 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-419b277c-16e6-4dfc-8a9d-209ebe6f166b" returned: 0 in 0.603s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:46:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb32957-b4bf-41d2-b70c-5105b830b881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-419b277c-16e6-4dfc-8a9d-209ebe6f166b', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832a8afd-0565-4971-b508-dd640dd83e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:40 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Volume volume-419b277c-16e6-4dfc-8a9d-209ebe6f166b (419b277c-16e6-4dfc-8a9d-209ebe6f166b): created successfully Jul 06 15:46:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832a8afd-0565-4971-b508-dd640dd83e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Flow 'volume_create_manager' (d0b0db9d-38ff-46a2-8e3b-e8a8b9741280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:40 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a725a3ac-ce76-486a-bfd9-9072822f49ff tempest-ProjectReaderTests-1083527420 None] Created volume successfully. Jul 06 15:46:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1d62b4ab-3a00-4d91-b28f-eed7fb74ea42 tempest-ProjectReaderTests-1083527420 None] Acquiring lock "cinder-419b277c-16e6-4dfc-8a9d-209ebe6f166b-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1d62b4ab-3a00-4d91-b28f-eed7fb74ea42 tempest-ProjectReaderTests-1083527420 None] Lock "cinder-419b277c-16e6-4dfc-8a9d-209ebe6f166b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1d62b4ab-3a00-4d91-b28f-eed7fb74ea42 tempest-ProjectReaderTests-1083527420 None] Acquiring lock "cinder-quobyte-419b277c-16e6-4dfc-8a9d-209ebe6f166b" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1d62b4ab-3a00-4d91-b28f-eed7fb74ea42 tempest-ProjectReaderTests-1083527420 None] Lock "cinder-quobyte-419b277c-16e6-4dfc-8a9d-209ebe6f166b" acquired by "delete_volume" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:41 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c062cbb-840e-4397-aeec-e9cce69a4b12]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1d62b4ab-3a00-4d91-b28f-eed7fb74ea42 tempest-ProjectReaderTests-1083527420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-419b277c-16e6-4dfc-8a9d-209ebe6f166b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:41 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-419b277c-16e6-4dfc-8a9d-209ebe6f166b Jul 06 15:46:41 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:42 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1d62b4ab-3a00-4d91-b28f-eed7fb74ea42 tempest-ProjectReaderTests-1083527420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-419b277c-16e6-4dfc-8a9d-209ebe6f166b" returned: 0 in 0.707s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1d62b4ab-3a00-4d91-b28f-eed7fb74ea42 tempest-ProjectReaderTests-1083527420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-419b277c-16e6-4dfc-8a9d-209ebe6f166b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:42 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-419b277c-16e6-4dfc-8a9d-209ebe6f166b Jul 06 15:46:42 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:42 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1d62b4ab-3a00-4d91-b28f-eed7fb74ea42 tempest-ProjectReaderTests-1083527420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-419b277c-16e6-4dfc-8a9d-209ebe6f166b" returned: 0 in 0.642s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:42 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1d62b4ab-3a00-4d91-b28f-eed7fb74ea42 tempest-ProjectReaderTests-1083527420 None] Lock "cinder-quobyte-419b277c-16e6-4dfc-8a9d-209ebe6f166b" released by "delete_volume" :: held 1.391s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:42 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-1d62b4ab-3a00-4d91-b28f-eed7fb74ea42 tempest-ProjectReaderTests-1083527420 None] Created reservations ['a77901be-9bf7-418b-8152-ea68d5d0b86b', '99692476-2234-452b-b376-4f460610e63d', '0a0b658d-814a-4013-bcf8-4bd925160125', 'df80fe89-b037-4249-9738-0b92fef1af61'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:46:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1d62b4ab-3a00-4d91-b28f-eed7fb74ea42 tempest-ProjectReaderTests-1083527420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1d62b4ab-3a00-4d91-b28f-eed7fb74ea42 tempest-ProjectReaderTests-1083527420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:43 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1d62b4ab-3a00-4d91-b28f-eed7fb74ea42 tempest-ProjectReaderTests-1083527420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:43 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1d62b4ab-3a00-4d91-b28f-eed7fb74ea42 tempest-ProjectReaderTests-1083527420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1d62b4ab-3a00-4d91-b28f-eed7fb74ea42 tempest-ProjectReaderTests-1083527420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1d62b4ab-3a00-4d91-b28f-eed7fb74ea42 tempest-ProjectReaderTests-1083527420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:43 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:46:43 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:43 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1d62b4ab-3a00-4d91-b28f-eed7fb74ea42 tempest-ProjectReaderTests-1083527420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.672s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:43 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-1d62b4ab-3a00-4d91-b28f-eed7fb74ea42 tempest-ProjectReaderTests-1083527420 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:46:43 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-1d62b4ab-3a00-4d91-b28f-eed7fb74ea42 tempest-ProjectReaderTests-1083527420 None] Deleted volume successfully. Jul 06 15:46:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1d62b4ab-3a00-4d91-b28f-eed7fb74ea42 tempest-ProjectReaderTests-1083527420 None] Lock "cinder-419b277c-16e6-4dfc-8a9d-209ebe6f166b-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:44 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:46:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Flow 'volume_create_manager' (b49b4500-10dd-4b40-84b3-72bb85c1721d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de2bc9a-f3ba-4014-b674-813c53d0f547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de2bc9a-f3ba-4014-b674-813c53d0f547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-574525985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d24064d-027a-4277-b948-044a0b9fc1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a528b44221349e5acfc9452cbeeaeec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:44Z,use_quota=True,user_id='120a2aba9d8848dcb65a0a5513422d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5cd23b-7642-4ba5-be82-92098c169574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5cd23b-7642-4ba5-be82-92098c169574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1ccf23-59ea-49ed-a9c0-dd54c15f31e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1ccf23-59ea-49ed-a9c0-dd54c15f31e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d24064d-027a-4277-b948-044a0b9fc1b2', 'volume_name': 'volume-7d24064d-027a-4277-b948-044a0b9fc1b2', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef57e49-5bd5-477c-900d-daac3995273e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef57e49-5bd5-477c-900d-daac3995273e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfedacf6-9b97-48f9-a846-d74c2de43ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:44 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Volume 7d24064d-027a-4277-b948-044a0b9fc1b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d24064d-027a-4277-b948-044a0b9fc1b2', 'volume_size': 1} Jul 06 15:46:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-574525985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d24064d-027a-4277-b948-044a0b9fc1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a528b44221349e5acfc9452cbeeaeec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:44Z,use_quota=True,user_id='120a2aba9d8848dcb65a0a5513422d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:46:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Creating volume 7d24064d-027a-4277-b948-044a0b9fc1b2 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:46:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:46:44 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:46:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d24064d-027a-4277-b948-044a0b9fc1b2 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:44 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d24064d-027a-4277-b948-044a0b9fc1b2 1073741824 Jul 06 15:46:44 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:44 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d24064d-027a-4277-b948-044a0b9fc1b2 1073741824" returned: 0 in 0.758s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:44 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:UPDATE=104,cinder:SELECT=76,cinder:DELETE=13,cinder:INSERT=25 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:46:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d24064d-027a-4277-b948-044a0b9fc1b2 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:45 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d24064d-027a-4277-b948-044a0b9fc1b2 Jul 06 15:46:45 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:45 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d24064d-027a-4277-b948-044a0b9fc1b2" returned: 0 in 0.606s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:46:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfedacf6-9b97-48f9-a846-d74c2de43ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d24064d-027a-4277-b948-044a0b9fc1b2', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (683bf93b-5520-4478-8bed-51b1218746bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:45 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Volume volume-7d24064d-027a-4277-b948-044a0b9fc1b2 (7d24064d-027a-4277-b948-044a0b9fc1b2): created successfully Jul 06 15:46:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (683bf93b-5520-4478-8bed-51b1218746bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Flow 'volume_create_manager' (b49b4500-10dd-4b40-84b3-72bb85c1721d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:45 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-6b8e5388-f8fd-4d4f-8d6b-703a62ca4331 tempest-ProjectReaderTests-1083527420 None] Created volume successfully. Jul 06 15:46:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-86954bee-ac18-43c4-9bec-98d2eaa6f33a tempest-ProjectReaderTests-1083527420 None] Acquiring lock "cinder-7d24064d-027a-4277-b948-044a0b9fc1b2-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-86954bee-ac18-43c4-9bec-98d2eaa6f33a tempest-ProjectReaderTests-1083527420 None] Lock "cinder-7d24064d-027a-4277-b948-044a0b9fc1b2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-86954bee-ac18-43c4-9bec-98d2eaa6f33a tempest-ProjectReaderTests-1083527420 None] Acquiring lock "cinder-quobyte-7d24064d-027a-4277-b948-044a0b9fc1b2" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-86954bee-ac18-43c4-9bec-98d2eaa6f33a tempest-ProjectReaderTests-1083527420 None] Lock "cinder-quobyte-7d24064d-027a-4277-b948-044a0b9fc1b2" acquired by "delete_volume" :: waited 0.014s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:46 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a163327-b308-46d3-b751-be32e6800640]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-86954bee-ac18-43c4-9bec-98d2eaa6f33a tempest-ProjectReaderTests-1083527420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d24064d-027a-4277-b948-044a0b9fc1b2 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:46 devstack sudo[104428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d24064d-027a-4277-b948-044a0b9fc1b2 Jul 06 15:46:46 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:47 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-86954bee-ac18-43c4-9bec-98d2eaa6f33a tempest-ProjectReaderTests-1083527420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d24064d-027a-4277-b948-044a0b9fc1b2" returned: 0 in 0.731s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-86954bee-ac18-43c4-9bec-98d2eaa6f33a tempest-ProjectReaderTests-1083527420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d24064d-027a-4277-b948-044a0b9fc1b2 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:47 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d24064d-027a-4277-b948-044a0b9fc1b2 Jul 06 15:46:47 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:47 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-86954bee-ac18-43c4-9bec-98d2eaa6f33a tempest-ProjectReaderTests-1083527420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d24064d-027a-4277-b948-044a0b9fc1b2" returned: 0 in 0.603s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:47 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-86954bee-ac18-43c4-9bec-98d2eaa6f33a tempest-ProjectReaderTests-1083527420 None] Lock "cinder-quobyte-7d24064d-027a-4277-b948-044a0b9fc1b2" released by "delete_volume" :: held 1.370s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:47 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-86954bee-ac18-43c4-9bec-98d2eaa6f33a tempest-ProjectReaderTests-1083527420 None] Created reservations ['a2de5bde-771a-41ec-8c29-1a2a8b3a9bc0', '65e83e94-60e3-4cc9-8e6b-383772f34127', 'c4e84b05-8f39-4c37-b16d-4731818b494d', '3c437bfd-d6a3-482d-9d60-57c51d0e3a6e'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:46:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-86954bee-ac18-43c4-9bec-98d2eaa6f33a tempest-ProjectReaderTests-1083527420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-86954bee-ac18-43c4-9bec-98d2eaa6f33a tempest-ProjectReaderTests-1083527420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:47 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-86954bee-ac18-43c4-9bec-98d2eaa6f33a tempest-ProjectReaderTests-1083527420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:47 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-86954bee-ac18-43c4-9bec-98d2eaa6f33a tempest-ProjectReaderTests-1083527420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-86954bee-ac18-43c4-9bec-98d2eaa6f33a tempest-ProjectReaderTests-1083527420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-86954bee-ac18-43c4-9bec-98d2eaa6f33a tempest-ProjectReaderTests-1083527420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:47 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:46:47 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:48 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-86954bee-ac18-43c4-9bec-98d2eaa6f33a tempest-ProjectReaderTests-1083527420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.665s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:48 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-86954bee-ac18-43c4-9bec-98d2eaa6f33a tempest-ProjectReaderTests-1083527420 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:46:48 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-86954bee-ac18-43c4-9bec-98d2eaa6f33a tempest-ProjectReaderTests-1083527420 None] Deleted volume successfully. Jul 06 15:46:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-86954bee-ac18-43c4-9bec-98d2eaa6f33a tempest-ProjectReaderTests-1083527420 None] Lock "cinder-7d24064d-027a-4277-b948-044a0b9fc1b2-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:48 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:46:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Flow 'volume_create_manager' (63070a44-9bab-4a29-a33c-a4c8b677493b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2853d09f-9791-4472-af5b-de019ea6a891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2853d09f-9791-4472-af5b-de019ea6a891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-62038069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30bfc70e-41ed-45cb-8553-3c13a64aeebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a528b44221349e5acfc9452cbeeaeec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:49Z,use_quota=True,user_id='120a2aba9d8848dcb65a0a5513422d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25204335-c52d-4820-9fe8-58e0e0928831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25204335-c52d-4820-9fe8-58e0e0928831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5439aed6-d4ce-49a7-98cc-9323abab1a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5439aed6-d4ce-49a7-98cc-9323abab1a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30bfc70e-41ed-45cb-8553-3c13a64aeebc', 'volume_name': 'volume-30bfc70e-41ed-45cb-8553-3c13a64aeebc', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e32ead76-b79c-4431-8193-871d609ea145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e32ead76-b79c-4431-8193-871d609ea145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ddaffc-a977-4b1d-b068-87212c491876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:48 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Volume 30bfc70e-41ed-45cb-8553-3c13a64aeebc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30bfc70e-41ed-45cb-8553-3c13a64aeebc', 'volume_size': 1} Jul 06 15:46:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:48 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-62038069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30bfc70e-41ed-45cb-8553-3c13a64aeebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a528b44221349e5acfc9452cbeeaeec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:49Z,use_quota=True,user_id='120a2aba9d8848dcb65a0a5513422d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:46:48 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Creating volume 30bfc70e-41ed-45cb-8553-3c13a64aeebc {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:46:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:46:49 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:46:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-30bfc70e-41ed-45cb-8553-3c13a64aeebc 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:49 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-30bfc70e-41ed-45cb-8553-3c13a64aeebc 1073741824 Jul 06 15:46:49 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:49 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-30bfc70e-41ed-45cb-8553-3c13a64aeebc 1073741824" returned: 0 in 0.811s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-30bfc70e-41ed-45cb-8553-3c13a64aeebc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:49 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-30bfc70e-41ed-45cb-8553-3c13a64aeebc Jul 06 15:46:49 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:50 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-30bfc70e-41ed-45cb-8553-3c13a64aeebc" returned: 0 in 0.626s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:50 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:46:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:50 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ddaffc-a977-4b1d-b068-87212c491876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30bfc70e-41ed-45cb-8553-3c13a64aeebc', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:50 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62fdd393-0516-473d-b2cb-f1a10688b204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:50 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Volume volume-30bfc70e-41ed-45cb-8553-3c13a64aeebc (30bfc70e-41ed-45cb-8553-3c13a64aeebc): created successfully Jul 06 15:46:50 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62fdd393-0516-473d-b2cb-f1a10688b204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:50 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Flow 'volume_create_manager' (63070a44-9bab-4a29-a33c-a4c8b677493b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:50 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a47a0e18-e442-451e-aea8-fe3852dd3bfc tempest-ProjectReaderTests-1083527420 None] Created volume successfully. Jul 06 15:46:51 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-66bea7f0-e36d-477c-8df5-d3074d1767a2 tempest-ProjectReaderTests-1083527420 None] Acquiring lock "cinder-30bfc70e-41ed-45cb-8553-3c13a64aeebc-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:51 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-66bea7f0-e36d-477c-8df5-d3074d1767a2 tempest-ProjectReaderTests-1083527420 None] Lock "cinder-30bfc70e-41ed-45cb-8553-3c13a64aeebc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:51 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-66bea7f0-e36d-477c-8df5-d3074d1767a2 tempest-ProjectReaderTests-1083527420 None] Acquiring lock "cinder-quobyte-30bfc70e-41ed-45cb-8553-3c13a64aeebc" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:51 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-66bea7f0-e36d-477c-8df5-d3074d1767a2 tempest-ProjectReaderTests-1083527420 None] Lock "cinder-quobyte-30bfc70e-41ed-45cb-8553-3c13a64aeebc" acquired by "delete_volume" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:51 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[b125722e-2886-4077-b93e-46143919708e]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-66bea7f0-e36d-477c-8df5-d3074d1767a2 tempest-ProjectReaderTests-1083527420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-30bfc70e-41ed-45cb-8553-3c13a64aeebc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:51 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-30bfc70e-41ed-45cb-8553-3c13a64aeebc Jul 06 15:46:51 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:51 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-66bea7f0-e36d-477c-8df5-d3074d1767a2 tempest-ProjectReaderTests-1083527420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-30bfc70e-41ed-45cb-8553-3c13a64aeebc" returned: 0 in 0.780s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-66bea7f0-e36d-477c-8df5-d3074d1767a2 tempest-ProjectReaderTests-1083527420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-30bfc70e-41ed-45cb-8553-3c13a64aeebc {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:51 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-30bfc70e-41ed-45cb-8553-3c13a64aeebc Jul 06 15:46:51 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:52 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-66bea7f0-e36d-477c-8df5-d3074d1767a2 tempest-ProjectReaderTests-1083527420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-30bfc70e-41ed-45cb-8553-3c13a64aeebc" returned: 0 in 0.698s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:52 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-66bea7f0-e36d-477c-8df5-d3074d1767a2 tempest-ProjectReaderTests-1083527420 None] Lock "cinder-quobyte-30bfc70e-41ed-45cb-8553-3c13a64aeebc" released by "delete_volume" :: held 1.515s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:52 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-66bea7f0-e36d-477c-8df5-d3074d1767a2 tempest-ProjectReaderTests-1083527420 None] Created reservations ['09a4ff84-95a7-45b2-95ef-27f5601b2081', '8c6d72b4-4f56-49e6-b302-848c683f1f39', '84b91652-29e3-4403-b57c-0005309390db', 'd4aebd79-8bf1-478f-9c5f-9c5fe38e376c'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:46:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-66bea7f0-e36d-477c-8df5-d3074d1767a2 tempest-ProjectReaderTests-1083527420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-66bea7f0-e36d-477c-8df5-d3074d1767a2 tempest-ProjectReaderTests-1083527420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:52 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-66bea7f0-e36d-477c-8df5-d3074d1767a2 tempest-ProjectReaderTests-1083527420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:52 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-66bea7f0-e36d-477c-8df5-d3074d1767a2 tempest-ProjectReaderTests-1083527420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-66bea7f0-e36d-477c-8df5-d3074d1767a2 tempest-ProjectReaderTests-1083527420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-66bea7f0-e36d-477c-8df5-d3074d1767a2 tempest-ProjectReaderTests-1083527420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:52 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:46:52 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:53 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-66bea7f0-e36d-477c-8df5-d3074d1767a2 tempest-ProjectReaderTests-1083527420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.628s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:53 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-66bea7f0-e36d-477c-8df5-d3074d1767a2 tempest-ProjectReaderTests-1083527420 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:46:53 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-66bea7f0-e36d-477c-8df5-d3074d1767a2 tempest-ProjectReaderTests-1083527420 None] Deleted volume successfully. Jul 06 15:46:53 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-66bea7f0-e36d-477c-8df5-d3074d1767a2 tempest-ProjectReaderTests-1083527420 None] Lock "cinder-30bfc70e-41ed-45cb-8553-3c13a64aeebc-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:02 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=32,cinder:INSERT=11,cinder:UPDATE=56,cinder:DELETE=4 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:47:03 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:UPDATE=20,cinder:DELETE=3,cinder:SELECT=11,cinder:INSERT=5 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Flow 'volume_create_manager' (60e6e51c-2011-44da-abce-5ad05f163b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (917ff801-fed1-4664-86f2-7803be5103ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (917ff801-fed1-4664-86f2-7803be5103ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-809979629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=428f7bb9-ef82-43b4-af7d-9c67322c4da1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9bb143185d2458493dd93707b6e7b91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:05Z,use_quota=True,user_id='2accca49c6074d0da2bd01a12ae52ff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (456dce08-62c1-4bcc-9fda-9db338e997c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (456dce08-62c1-4bcc-9fda-9db338e997c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f852a941-a3d5-4937-ba6e-c255f31bd9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f852a941-a3d5-4937-ba6e-c255f31bd9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '428f7bb9-ef82-43b4-af7d-9c67322c4da1', 'volume_name': 'volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f584fb-f8da-4440-978b-d9ae2278ad14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f584fb-f8da-4440-978b-d9ae2278ad14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77f2f55d-8906-47a2-9ae1-4f1581734d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:05 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Volume 428f7bb9-ef82-43b4-af7d-9c67322c4da1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1', 'volume_size': 1} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-809979629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=428f7bb9-ef82-43b4-af7d-9c67322c4da1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9bb143185d2458493dd93707b6e7b91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:05Z,use_quota=True,user_id='2accca49c6074d0da2bd01a12ae52ff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Creating volume 428f7bb9-ef82-43b4-af7d-9c67322c4da1 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:05 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:05 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1 1073741824 Jul 06 15:47:05 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Flow 'volume_create_manager' (ae6f0991-d72d-4f6e-88d0-2ce8c61789e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cbbbf5d-cd5e-48b2-9994-ed60742d6573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cbbbf5d-cd5e-48b2-9994-ed60742d6573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1344024196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f854df-a315-4890-a0cb-0e898ab16d4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e701a43047344707a3e6a1330355ad77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:05Z,use_quota=True,user_id='a804539c483c43a6be40c26fa04290f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8748e977-51f2-44bc-9406-caa820055a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8748e977-51f2-44bc-9406-caa820055a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a164939-b6fd-4b12-a815-de81bfc71582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a164939-b6fd-4b12-a815-de81bfc71582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32f854df-a315-4890-a0cb-0e898ab16d4e', 'volume_name': 'volume-32f854df-a315-4890-a0cb-0e898ab16d4e', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87901de0-e65b-4222-ae1c-30d7c918caa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87901de0-e65b-4222-ae1c-30d7c918caa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c85b17-d7ea-46a9-a099-e5f0e1d88157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:05 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Volume 32f854df-a315-4890-a0cb-0e898ab16d4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32f854df-a315-4890-a0cb-0e898ab16d4e', 'volume_size': 1} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:05 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Flow 'volume_create_manager' (05d1d825-5366-4e5d-b04b-52e80b6fd49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad6f9b61-72f5-457b-89e2-4b384a79937c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad6f9b61-72f5-457b-89e2-4b384a79937c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1139334163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b827f316-4c48-498b-8f30-2843addf99ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e701a43047344707a3e6a1330355ad77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:06Z,use_quota=True,user_id='a804539c483c43a6be40c26fa04290f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6328f17f-f27c-460f-a0a7-ba77b73f3867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6328f17f-f27c-460f-a0a7-ba77b73f3867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc8db6d-9ed6-461a-973c-87e1ed7883f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc8db6d-9ed6-461a-973c-87e1ed7883f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b827f316-4c48-498b-8f30-2843addf99ce', 'volume_name': 'volume-b827f316-4c48-498b-8f30-2843addf99ce', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98cbd6d3-230e-4539-8612-f9714107c757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98cbd6d3-230e-4539-8612-f9714107c757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82efa9bb-bc36-4fd1-9713-5ab74bf0ba96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:06 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Volume b827f316-4c48-498b-8f30-2843addf99ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b827f316-4c48-498b-8f30-2843addf99ce', 'volume_size': 1} Jul 06 15:47:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:06 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1 1073741824" returned: 0 in 1.099s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:06 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1 Jul 06 15:47:06 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:06 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Flow 'volume_create_manager' (f7c8e83b-4237-44cd-b8b6-293764bfe071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60438a78-bd32-49fb-97cf-8e5b48bdf526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60438a78-bd32-49fb-97cf-8e5b48bdf526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1641057023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6d31a8e-bd99-4a0f-9fa4-67d752d8415f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e701a43047344707a3e6a1330355ad77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:07Z,use_quota=True,user_id='a804539c483c43a6be40c26fa04290f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e356f848-2da1-432f-a306-206a85d45f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e356f848-2da1-432f-a306-206a85d45f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c46470c0-8e1b-416d-a364-6c9284a1d293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c46470c0-8e1b-416d-a364-6c9284a1d293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6d31a8e-bd99-4a0f-9fa4-67d752d8415f', 'volume_name': 'volume-d6d31a8e-bd99-4a0f-9fa4-67d752d8415f', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da66925-1afc-44c8-9d2c-447508ad9ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da66925-1afc-44c8-9d2c-447508ad9ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:06 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da1ed301-371f-4061-beb7-972ea8cd6395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:06 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Volume d6d31a8e-bd99-4a0f-9fa4-67d752d8415f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6d31a8e-bd99-4a0f-9fa4-67d752d8415f', 'volume_size': 1} Jul 06 15:47:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Flow 'volume_create_manager' (dba91d6e-0060-476e-ae30-b857476e5d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4499a0b5-cf07-478d-a7c9-e0c8d0925277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4499a0b5-cf07-478d-a7c9-e0c8d0925277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-578721428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=123ad6cd-6166-40ef-9e2e-b7dbaa7f1056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e701a43047344707a3e6a1330355ad77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:07Z,use_quota=True,user_id='a804539c483c43a6be40c26fa04290f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95619cae-9f78-456b-986c-4e2a0e756cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95619cae-9f78-456b-986c-4e2a0e756cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae147da-a4ba-4c70-9eaf-968822792ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae147da-a4ba-4c70-9eaf-968822792ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '123ad6cd-6166-40ef-9e2e-b7dbaa7f1056', 'volume_name': 'volume-123ad6cd-6166-40ef-9e2e-b7dbaa7f1056', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d81bec9-ed9b-4c8f-a808-40cade440a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d81bec9-ed9b-4c8f-a808-40cade440a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ad6df5-7f02-44e6-95ef-2713a56e9dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:07 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Volume 123ad6cd-6166-40ef-9e2e-b7dbaa7f1056: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-123ad6cd-6166-40ef-9e2e-b7dbaa7f1056', 'volume_size': 1} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:07 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1" returned: 0 in 1.100s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] <== create_volume: return (2276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.281s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.955s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1344024196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f854df-a315-4890-a0cb-0e898ab16d4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e701a43047344707a3e6a1330355ad77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:05Z,use_quota=True,user_id='a804539c483c43a6be40c26fa04290f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Creating volume 32f854df-a315-4890-a0cb-0e898ab16d4e {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:07 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-32f854df-a315-4890-a0cb-0e898ab16d4e 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:07 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-32f854df-a315-4890-a0cb-0e898ab16d4e 1073741824 Jul 06 15:47:07 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77f2f55d-8906-47a2-9ae1-4f1581734d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a6b8e6-2b4a-4939-aaaf-41cbedb21cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:07 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Volume volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1 (428f7bb9-ef82-43b4-af7d-9c67322c4da1): created successfully Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a6b8e6-2b4a-4939-aaaf-41cbedb21cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Flow 'volume_create_manager' (60e6e51c-2011-44da-abce-5ad05f163b4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Flow 'volume_create_manager' (5481ac16-251e-4057-9933-5f6d9848777e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a5c2cc-e61a-438a-8b2c-84eb1533f1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:07 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-9e93dc9b-a0e7-4324-8361-b4931c12fa8d tempest-CreateVolumesFromSnapshotTest-1262682818 None] Created volume successfully. Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a5c2cc-e61a-438a-8b2c-84eb1533f1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1625824426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8820a47e-988a-4c7d-8995-0cece062f2f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e701a43047344707a3e6a1330355ad77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:08Z,use_quota=True,user_id='a804539c483c43a6be40c26fa04290f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc3f2b7e-5372-4a93-b87a-f8e84a5eafc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc3f2b7e-5372-4a93-b87a-f8e84a5eafc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (883ad5c8-25ac-471d-b27c-fe85060d2c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (883ad5c8-25ac-471d-b27c-fe85060d2c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8820a47e-988a-4c7d-8995-0cece062f2f0', 'volume_name': 'volume-8820a47e-988a-4c7d-8995-0cece062f2f0', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e226e68-74e8-4757-aaed-9b35d1843ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e226e68-74e8-4757-aaed-9b35d1843ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c593791-09d2-4924-9b3f-b2490459bff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:07 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Volume 8820a47e-988a-4c7d-8995-0cece062f2f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8820a47e-988a-4c7d-8995-0cece062f2f0', 'volume_size': 1} Jul 06 15:47:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:08 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-32f854df-a315-4890-a0cb-0e898ab16d4e 1073741824" returned: 0 in 0.992s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-32f854df-a315-4890-a0cb-0e898ab16d4e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:08 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-32f854df-a315-4890-a0cb-0e898ab16d4e Jul 06 15:47:08 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e92873e9-da43-42e7-b5a0-f75c212d2555 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Flow 'volume_create_manager' (f3d68bf5-d54d-46a0-9125-4c1997be5f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3401b37e-c5d4-46b1-a9e0-9a493be615db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3401b37e-c5d4-46b1-a9e0-9a493be615db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27e5000c-b22e-4004-b3cf-2ad64214a2d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14cc1a653c7a450284718964239e2f9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:09Z,use_quota=True,user_id='e965a25f18d84c92b87ab7ca1149c4f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4f937c9-c00d-445b-8653-29a764676f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4f937c9-c00d-445b-8653-29a764676f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e58400d-d3e2-4702-9ab8-6d2608919a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG cinder.image.glance [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Creating Keystone auth plugin from conf {{(pid=86148) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e58400d-d3e2-4702-9ab8-6d2608919a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '27e5000c-b22e-4004-b3cf-2ad64214a2d3', 'volume_name': 'volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3', 'volume_size': 1, 'image_id': 'fed4e0cf-d865-461a-a2d6-aef32b6c82c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fed4e0cf-d865-461a-a2d6-aef32b6c82c7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0c4fac96284a688474774f9cdd9e9c26', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '14cc1a653c7a450284718964239e2f9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8c6c97ffb8db8e061a2bbaba6c73911969b780e2246e2c84a7a2ad5800d4f11234db9c12c5a83442013ccd9bad94260ed72508069b9ac429fde1b9097ca1bd8d', 'id': 'fed4e0cf-d865-461a-a2d6-aef32b6c82c7', 'created_at': datetime.datetime(2026, 7, 6, 13, 47, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 47, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fed4e0cf-d865-461a-a2d6-aef32b6c82c7/file', 'properties': {}}, 'image_service': }' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ab2e570-c44e-49c1-bf79-1258473e9965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ab2e570-c44e-49c1-bf79-1258473e9965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:09 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fb2bbf-c1b7-433f-a150-844248299da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:09 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Volume 27e5000c-b22e-4004-b3cf-2ad64214a2d3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3', 'volume_size': 1, 'image_id': 'fed4e0cf-d865-461a-a2d6-aef32b6c82c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fed4e0cf-d865-461a-a2d6-aef32b6c82c7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0c4fac96284a688474774f9cdd9e9c26', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '14cc1a653c7a450284718964239e2f9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8c6c97ffb8db8e061a2bbaba6c73911969b780e2246e2c84a7a2ad5800d4f11234db9c12c5a83442013ccd9bad94260ed72508069b9ac429fde1b9097ca1bd8d', 'id': 'fed4e0cf-d865-461a-a2d6-aef32b6c82c7', 'created_at': datetime.datetime(2026, 7, 6, 13, 47, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 47, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fed4e0cf-d865-461a-a2d6-aef32b6c82c7/file', 'properties': {}}, 'image_service': } Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Trying to clone 27e5000c-b22e-4004-b3cf-2ad64214a2d3 from image fed4e0cf-d865-461a-a2d6-aef32b6c82c7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fed4e0cf-d865-461a-a2d6-aef32b6c82c7', 'metadata': {}}]). {{(pid=86148) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-32f854df-a315-4890-a0cb-0e898ab16d4e" returned: 0 in 0.755s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.241s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1139334163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b827f316-4c48-498b-8f30-2843addf99ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e701a43047344707a3e6a1330355ad77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:06Z,use_quota=True,user_id='a804539c483c43a6be40c26fa04290f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Creating volume b827f316-4c48-498b-8f30-2843addf99ce {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:09 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b827f316-4c48-498b-8f30-2843addf99ce 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c85b17-d7ea-46a9-a099-e5f0e1d88157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32f854df-a315-4890-a0cb-0e898ab16d4e', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:09 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b827f316-4c48-498b-8f30-2843addf99ce 1073741824 Jul 06 15:47:09 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed62db2-5e02-48a1-92df-d9f655391fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:09 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Volume volume-32f854df-a315-4890-a0cb-0e898ab16d4e (32f854df-a315-4890-a0cb-0e898ab16d4e): created successfully Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed62db2-5e02-48a1-92df-d9f655391fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Flow 'volume_create_manager' (ae6f0991-d72d-4f6e-88d0-2ce8c61789e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fed4e0cf-d865-461a-a2d6-aef32b6c82c7_44b_9twpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86148) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 15:47:09 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Image download 0.00 MB at 0.00 MB/s Jul 06 15:47:09 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a87bf6eb-2906-49c9-b4f1-da886dfbaab3 tempest-CreateVolumesFromImageTest-170619856 None] Created volume successfully. Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[d167fbe4-0d9e-436a-913a-c56a66691f19]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fed4e0cf-d865-461a-a2d6-aef32b6c82c7_44b_9twpdevstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:09 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fed4e0cf-d865-461a-a2d6-aef32b6c82c7_44b_9twpdevstack@QuobyteHD Jul 06 15:47:09 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:10 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Flow 'volume_create_manager' (0a674b10-387e-4ebb-ad12-4f8943b65852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b610c2-0509-4bfb-a764-ee4c0b9002fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b610c2-0509-4bfb-a764-ee4c0b9002fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4dd10e-1301-45ef-b824-8a6aadfdefed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f17181d21cd41e59c7032f477c950a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:10Z,use_quota=True,user_id='36d8ef7fd23742eba9730c0eb8134ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67a41747-d914-4940-9a3a-757e7e17f87b),volume_type_id=67a41747-d914-4940-9a3a-757e7e17f87b)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31c6f47-ed8d-4e23-89da-1f87548cdb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31c6f47-ed8d-4e23-89da-1f87548cdb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e0b586-d9f5-429d-90a5-f92a7de6a3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:10 devstack cinder-volume[86148]: DEBUG cinder.image.glance [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Creating Keystone auth plugin from conf {{(pid=86148) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 15:47:10 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fed4e0cf-d865-461a-a2d6-aef32b6c82c7_44b_9twpdevstack@QuobyteHD" returned: 0 in 0.778s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fed4e0cf-d865-461a-a2d6-aef32b6c82c7_44b_9twpdevstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:10 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b827f316-4c48-498b-8f30-2843addf99ce 1073741824" returned: 0 in 0.974s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b827f316-4c48-498b-8f30-2843addf99ce {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:10 devstack sudo[104533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fed4e0cf-d865-461a-a2d6-aef32b6c82c7_44b_9twpdevstack@QuobyteHD Jul 06 15:47:10 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:10 devstack sudo[104534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b827f316-4c48-498b-8f30-2843addf99ce Jul 06 15:47:10 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e0b586-d9f5-429d-90a5-f92a7de6a3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3b4dd10e-1301-45ef-b824-8a6aadfdefed', 'volume_name': 'volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed', 'volume_size': 1, 'image_id': 'bcf4ae79-0b81-42d0-b1e5-e464d82ff031', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bcf4ae79-0b81-42d0-b1e5-e464d82ff031', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '66f8d2b46b296f8aced50d19b8f024ab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1f17181d21cd41e59c7032f477c950a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '64d9d0cc20e199503ee5b5e380f5eac1332226ef3a543c8b206c4cd5169fef606a4190f557f7ae825eef2ebacaa5d644283a4c294b9340c1cc2fd45342b43f82', 'id': 'bcf4ae79-0b81-42d0-b1e5-e464d82ff031', 'created_at': datetime.datetime(2026, 7, 6, 13, 47, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 47, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bcf4ae79-0b81-42d0-b1e5-e464d82ff031/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba741a4-43af-46b0-957e-438da2df86c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba741a4-43af-46b0-957e-438da2df86c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee71741-ef43-4895-9d2b-a76115d57d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:10 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Volume 3b4dd10e-1301-45ef-b824-8a6aadfdefed: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed', 'volume_size': 1, 'image_id': 'bcf4ae79-0b81-42d0-b1e5-e464d82ff031', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bcf4ae79-0b81-42d0-b1e5-e464d82ff031', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '66f8d2b46b296f8aced50d19b8f024ab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1f17181d21cd41e59c7032f477c950a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '64d9d0cc20e199503ee5b5e380f5eac1332226ef3a543c8b206c4cd5169fef606a4190f557f7ae825eef2ebacaa5d644283a4c294b9340c1cc2fd45342b43f82', 'id': 'bcf4ae79-0b81-42d0-b1e5-e464d82ff031', 'created_at': datetime.datetime(2026, 7, 6, 13, 47, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 47, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bcf4ae79-0b81-42d0-b1e5-e464d82ff031/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 06 15:47:10 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Trying to clone 3b4dd10e-1301-45ef-b824-8a6aadfdefed from image bcf4ae79-0b81-42d0-b1e5-e464d82ff031 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bcf4ae79-0b81-42d0-b1e5-e464d82ff031', 'metadata': {}}]). {{(pid=86148) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 15:47:10 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_5w2pruy7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86148) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 15:47:10 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Image download 0.00 MB at 0.00 MB/s Jul 06 15:47:10 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[d232408a-20bf-411b-9056-f001bb046bbd]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_5w2pruy7devstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:10 devstack sudo[104537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_5w2pruy7devstack@QuobyteHD Jul 06 15:47:10 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:11 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fed4e0cf-d865-461a-a2d6-aef32b6c82c7_44b_9twpdevstack@QuobyteHD" returned: 1 in 0.726s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fed4e0cf-d865-461a-a2d6-aef32b6c82c7_44b_9twpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:47:11 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:11 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Temporary image fed4e0cf-d865-461a-a2d6-aef32b6c82c7 is fetched for user e965a25f18d84c92b87ab7ca1149c4f5. {{(pid=86148) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 15:47:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b827f316-4c48-498b-8f30-2843addf99ce" returned: 0 in 0.656s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.111s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1641057023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6d31a8e-bd99-4a0f-9fa4-67d752d8415f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e701a43047344707a3e6a1330355ad77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:07Z,use_quota=True,user_id='a804539c483c43a6be40c26fa04290f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Creating volume d6d31a8e-bd99-4a0f-9fa4-67d752d8415f {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:11 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:47:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6d31a8e-bd99-4a0f-9fa4-67d752d8415f 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:11 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6d31a8e-bd99-4a0f-9fa4-67d752d8415f 1073741824 Jul 06 15:47:11 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82efa9bb-bc36-4fd1-9713-5ab74bf0ba96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b827f316-4c48-498b-8f30-2843addf99ce', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34643922-fc3c-41a3-98cc-4bdf55de6992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:11 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Volume volume-b827f316-4c48-498b-8f30-2843addf99ce (b827f316-4c48-498b-8f30-2843addf99ce): created successfully Jul 06 15:47:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34643922-fc3c-41a3-98cc-4bdf55de6992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Flow 'volume_create_manager' (05d1d825-5366-4e5d-b04b-52e80b6fd49f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:11 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-b5a15e5c-c40b-47b3-bea4-f4ca1b458c0e tempest-CreateVolumesFromImageTest-170619856 None] Created volume successfully. Jul 06 15:47:11 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55c5b0f-2c93-4ee7-be65-a89e324c5e69]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fed4e0cf-d865-461a-a2d6-aef32b6c82c7_44b_9twpdevstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:11 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fed4e0cf-d865-461a-a2d6-aef32b6c82c7_44b_9twpdevstack@QuobyteHD Jul 06 15:47:11 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:11 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_5w2pruy7devstack@QuobyteHD" returned: 0 in 0.844s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_5w2pruy7devstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:11 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_5w2pruy7devstack@QuobyteHD Jul 06 15:47:11 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:11 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:11 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fed4e0cf-d865-461a-a2d6-aef32b6c82c7_44b_9twpdevstack@QuobyteHD" returned: 0 in 0.786s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fed4e0cf-d865-461a-a2d6-aef32b6c82c7_44b_9twpdevstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6d31a8e-bd99-4a0f-9fa4-67d752d8415f 1073741824" returned: 0 in 0.908s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6d31a8e-bd99-4a0f-9fa4-67d752d8415f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:12 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6d31a8e-bd99-4a0f-9fa4-67d752d8415f Jul 06 15:47:12 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:12 devstack sudo[104556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fed4e0cf-d865-461a-a2d6-aef32b6c82c7_44b_9twpdevstack@QuobyteHD Jul 06 15:47:12 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:12 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_5w2pruy7devstack@QuobyteHD" returned: 1 in 0.803s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_5w2pruy7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:47:12 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Temporary image bcf4ae79-0b81-42d0-b1e5-e464d82ff031 is fetched for user 36d8ef7fd23742eba9730c0eb8134ea9. {{(pid=86148) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 15:47:12 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c1d2ce-3128-4f76-ba82-5c9e7a80fa33]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_5w2pruy7devstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:12 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_5w2pruy7devstack@QuobyteHD Jul 06 15:47:12 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:12 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6d31a8e-bd99-4a0f-9fa4-67d752d8415f" returned: 0 in 0.674s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.225s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-578721428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=123ad6cd-6166-40ef-9e2e-b7dbaa7f1056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e701a43047344707a3e6a1330355ad77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:07Z,use_quota=True,user_id='a804539c483c43a6be40c26fa04290f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Creating volume 123ad6cd-6166-40ef-9e2e-b7dbaa7f1056 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:12 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:47:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-123ad6cd-6166-40ef-9e2e-b7dbaa7f1056 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:12 devstack sudo[104569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-123ad6cd-6166-40ef-9e2e-b7dbaa7f1056 1073741824 Jul 06 15:47:12 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da1ed301-371f-4061-beb7-972ea8cd6395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6d31a8e-bd99-4a0f-9fa4-67d752d8415f', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f672c98f-090f-4650-a61b-52254e7d95c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:12 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Volume volume-d6d31a8e-bd99-4a0f-9fa4-67d752d8415f (d6d31a8e-bd99-4a0f-9fa4-67d752d8415f): created successfully Jul 06 15:47:12 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f672c98f-090f-4650-a61b-52254e7d95c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:12 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Flow 'volume_create_manager' (f7c8e83b-4237-44cd-b8b6-293764bfe071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fed4e0cf-d865-461a-a2d6-aef32b6c82c7_44b_9twpdevstack@QuobyteHD" returned: 1 in 0.821s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fed4e0cf-d865-461a-a2d6-aef32b6c82c7_44b_9twpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:47:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:12 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-0be2cde3-81bf-4875-9611-183bfa07266b tempest-CreateVolumesFromImageTest-170619856 None] Created volume successfully. Jul 06 15:47:13 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_5w2pruy7devstack@QuobyteHD" returned: 0 in 0.759s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_5w2pruy7devstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:13 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_5w2pruy7devstack@QuobyteHD Jul 06 15:47:13 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:13 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-123ad6cd-6166-40ef-9e2e-b7dbaa7f1056 1073741824" returned: 0 in 0.809s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-123ad6cd-6166-40ef-9e2e-b7dbaa7f1056 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:13 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-123ad6cd-6166-40ef-9e2e-b7dbaa7f1056 Jul 06 15:47:13 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:13 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_5w2pruy7devstack@QuobyteHD" returned: 1 in 0.725s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_5w2pruy7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:47:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:14 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-123ad6cd-6166-40ef-9e2e-b7dbaa7f1056" returned: 0 in 0.629s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.389s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1625824426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8820a47e-988a-4c7d-8995-0cece062f2f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e701a43047344707a3e6a1330355ad77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:08Z,use_quota=True,user_id='a804539c483c43a6be40c26fa04290f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Creating volume 8820a47e-988a-4c7d-8995-0cece062f2f0 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:14 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:14 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:47:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8820a47e-988a-4c7d-8995-0cece062f2f0 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ad6df5-7f02-44e6-95ef-2713a56e9dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-123ad6cd-6166-40ef-9e2e-b7dbaa7f1056', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d306fdbb-b5f6-4402-b295-fc3d550b206c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:14 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8820a47e-988a-4c7d-8995-0cece062f2f0 1073741824 Jul 06 15:47:14 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:14 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Volume volume-123ad6cd-6166-40ef-9e2e-b7dbaa7f1056 (123ad6cd-6166-40ef-9e2e-b7dbaa7f1056): created successfully Jul 06 15:47:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d306fdbb-b5f6-4402-b295-fc3d550b206c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Flow 'volume_create_manager' (dba91d6e-0060-476e-ae30-b857476e5d9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:14 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-c8e391e3-d44e-48c7-b17d-ea3c73e956f7 tempest-CreateVolumesFromImageTest-170619856 None] Created volume successfully. Jul 06 15:47:14 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8820a47e-988a-4c7d-8995-0cece062f2f0 1073741824" returned: 0 in 0.805s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8820a47e-988a-4c7d-8995-0cece062f2f0 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:15 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8820a47e-988a-4c7d-8995-0cece062f2f0 Jul 06 15:47:15 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:15 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8820a47e-988a-4c7d-8995-0cece062f2f0" returned: 0 in 0.644s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:15 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e92873e9-da43-42e7-b5a0-f75c212d2555 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.956s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:15 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-e92873e9-da43-42e7-b5a0-f75c212d2555 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Creating offline snapshot 7b9e49c5-e004-4fcb-a7ae-060eb61271f3 of volume 428f7bb9-ef82-43b4-af7d-9c67322c4da1 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:47:15 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c593791-09d2-4924-9b3f-b2490459bff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8820a47e-988a-4c7d-8995-0cece062f2f0', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:15 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95e82afc-1fde-4a8e-a6cb-e0403a6fbe5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:15 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[274f77ac-683b-4548-90cc-f1be163b7ae8]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e92873e9-da43-42e7-b5a0-f75c212d2555 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:15 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Volume volume-8820a47e-988a-4c7d-8995-0cece062f2f0 (8820a47e-988a-4c7d-8995-0cece062f2f0): created successfully Jul 06 15:47:15 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95e82afc-1fde-4a8e-a6cb-e0403a6fbe5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:15 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Flow 'volume_create_manager' (5481ac16-251e-4057-9933-5f6d9848777e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:15 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-355df191-6868-45fc-89ab-f963a04dd5b7 tempest-CreateVolumesFromImageTest-170619856 None] Created volume successfully. Jul 06 15:47:15 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1 Jul 06 15:47:15 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:16 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e92873e9-da43-42e7-b5a0-f75c212d2555 tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1" returned: 0 in 0.771s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e92873e9-da43-42e7-b5a0-f75c212d2555 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1.7b9e49c5-e004-4fcb-a7ae-060eb61271f3 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:16 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-05b870e7-9925-4e92-b105-c51087d889ba tempest-CreateVolumesFromImageTest-170619856 None] Acquiring lock "cinder-8820a47e-988a-4c7d-8995-0cece062f2f0-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:16 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1.7b9e49c5-e004-4fcb-a7ae-060eb61271f3 1G Jul 06 15:47:16 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:16 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-05b870e7-9925-4e92-b105-c51087d889ba tempest-CreateVolumesFromImageTest-170619856 None] Lock "cinder-8820a47e-988a-4c7d-8995-0cece062f2f0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:16 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-05b870e7-9925-4e92-b105-c51087d889ba tempest-CreateVolumesFromImageTest-170619856 None] Acquiring lock "cinder-quobyte-8820a47e-988a-4c7d-8995-0cece062f2f0" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:16 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-05b870e7-9925-4e92-b105-c51087d889ba tempest-CreateVolumesFromImageTest-170619856 None] Lock "cinder-quobyte-8820a47e-988a-4c7d-8995-0cece062f2f0" acquired by "delete_volume" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:16 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dd866d-188d-40b4-8570-aa97df2aaa08]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-05b870e7-9925-4e92-b105-c51087d889ba tempest-CreateVolumesFromImageTest-170619856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8820a47e-988a-4c7d-8995-0cece062f2f0 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:16 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8820a47e-988a-4c7d-8995-0cece062f2f0 Jul 06 15:47:16 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:17 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e92873e9-da43-42e7-b5a0-f75c212d2555 tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1.7b9e49c5-e004-4fcb-a7ae-060eb61271f3 1G" returned: 0 in 0.782s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e92873e9-da43-42e7-b5a0-f75c212d2555 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1.7b9e49c5-e004-4fcb-a7ae-060eb61271f3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:17 devstack sudo[104607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1.7b9e49c5-e004-4fcb-a7ae-060eb61271f3 Jul 06 15:47:17 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:17 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-05b870e7-9925-4e92-b105-c51087d889ba tempest-CreateVolumesFromImageTest-170619856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8820a47e-988a-4c7d-8995-0cece062f2f0" returned: 0 in 0.753s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-05b870e7-9925-4e92-b105-c51087d889ba tempest-CreateVolumesFromImageTest-170619856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8820a47e-988a-4c7d-8995-0cece062f2f0 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:17 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8820a47e-988a-4c7d-8995-0cece062f2f0 Jul 06 15:47:17 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:17 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e92873e9-da43-42e7-b5a0-f75c212d2555 tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1.7b9e49c5-e004-4fcb-a7ae-060eb61271f3" returned: 0 in 0.712s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:17 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-e92873e9-da43-42e7-b5a0-f75c212d2555 tempest-CreateVolumesFromSnapshotTest-1262682818 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1.7b9e49c5-e004-4fcb-a7ae-060eb61271f3 is being set with open permissions: ugo+rw Jul 06 15:47:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e92873e9-da43-42e7-b5a0-f75c212d2555 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1.7b9e49c5-e004-4fcb-a7ae-060eb61271f3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:18 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1.7b9e49c5-e004-4fcb-a7ae-060eb61271f3 Jul 06 15:47:18 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:18 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-05b870e7-9925-4e92-b105-c51087d889ba tempest-CreateVolumesFromImageTest-170619856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-8820a47e-988a-4c7d-8995-0cece062f2f0" returned: 0 in 0.652s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:18 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-05b870e7-9925-4e92-b105-c51087d889ba tempest-CreateVolumesFromImageTest-170619856 None] Lock "cinder-quobyte-8820a47e-988a-4c7d-8995-0cece062f2f0" released by "delete_volume" :: held 1.450s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:18 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-05b870e7-9925-4e92-b105-c51087d889ba tempest-CreateVolumesFromImageTest-170619856 None] Created reservations ['ab3b4326-ac2f-4b69-91f4-60eb3081b92c', '028fb4ca-7723-4348-b6bd-22ca7c89c938', '75201a35-acdc-4ab0-b16a-5e8189b5db63', 'adf135e5-b3a8-4acd-9a21-99e330452d2a'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-05b870e7-9925-4e92-b105-c51087d889ba tempest-CreateVolumesFromImageTest-170619856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-05b870e7-9925-4e92-b105-c51087d889ba tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:18 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-05b870e7-9925-4e92-b105-c51087d889ba tempest-CreateVolumesFromImageTest-170619856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:18 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-05b870e7-9925-4e92-b105-c51087d889ba tempest-CreateVolumesFromImageTest-170619856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-05b870e7-9925-4e92-b105-c51087d889ba tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-05b870e7-9925-4e92-b105-c51087d889ba tempest-CreateVolumesFromImageTest-170619856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:18 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:47:18 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:18 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e92873e9-da43-42e7-b5a0-f75c212d2555 tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1.7b9e49c5-e004-4fcb-a7ae-060eb61271f3" returned: 0 in 0.685s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e92873e9-da43-42e7-b5a0-f75c212d2555 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:18 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1.info Jul 06 15:47:18 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:18 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-74b2288a-c76b-4fe3-b247-f36f8ff6e53b tempest-CreateVolumesFromImageTest-170619856 None] Acquiring lock "cinder-123ad6cd-6166-40ef-9e2e-b7dbaa7f1056-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:18 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-74b2288a-c76b-4fe3-b247-f36f8ff6e53b tempest-CreateVolumesFromImageTest-170619856 None] Lock "cinder-123ad6cd-6166-40ef-9e2e-b7dbaa7f1056-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:18 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-74b2288a-c76b-4fe3-b247-f36f8ff6e53b tempest-CreateVolumesFromImageTest-170619856 None] Acquiring lock "cinder-quobyte-123ad6cd-6166-40ef-9e2e-b7dbaa7f1056" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:18 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-05b870e7-9925-4e92-b105-c51087d889ba tempest-CreateVolumesFromImageTest-170619856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.679s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:18 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-05b870e7-9925-4e92-b105-c51087d889ba tempest-CreateVolumesFromImageTest-170619856 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:18 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-05b870e7-9925-4e92-b105-c51087d889ba tempest-CreateVolumesFromImageTest-170619856 None] Deleted volume successfully. Jul 06 15:47:18 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-74b2288a-c76b-4fe3-b247-f36f8ff6e53b tempest-CreateVolumesFromImageTest-170619856 None] Lock "cinder-quobyte-123ad6cd-6166-40ef-9e2e-b7dbaa7f1056" acquired by "delete_volume" :: waited 0.021s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:18 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[178b266e-bab2-4c3b-9ffc-5292a5ad9612]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:18 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-05b870e7-9925-4e92-b105-c51087d889ba tempest-CreateVolumesFromImageTest-170619856 None] Lock "cinder-8820a47e-988a-4c7d-8995-0cece062f2f0-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-74b2288a-c76b-4fe3-b247-f36f8ff6e53b tempest-CreateVolumesFromImageTest-170619856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-123ad6cd-6166-40ef-9e2e-b7dbaa7f1056 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:18 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-123ad6cd-6166-40ef-9e2e-b7dbaa7f1056 Jul 06 15:47:18 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:19 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e92873e9-da43-42e7-b5a0-f75c212d2555 tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1.info" returned: 0 in 0.667s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:19 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-e92873e9-da43-42e7-b5a0-f75c212d2555 tempest-CreateVolumesFromSnapshotTest-1262682818 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1.info is being set with open permissions: ugo+rw Jul 06 15:47:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e92873e9-da43-42e7-b5a0-f75c212d2555 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:19 devstack sudo[104627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1.info Jul 06 15:47:19 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:19 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-74b2288a-c76b-4fe3-b247-f36f8ff6e53b tempest-CreateVolumesFromImageTest-170619856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-123ad6cd-6166-40ef-9e2e-b7dbaa7f1056" returned: 0 in 0.786s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-74b2288a-c76b-4fe3-b247-f36f8ff6e53b tempest-CreateVolumesFromImageTest-170619856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-123ad6cd-6166-40ef-9e2e-b7dbaa7f1056 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:19 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-123ad6cd-6166-40ef-9e2e-b7dbaa7f1056 Jul 06 15:47:19 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:20 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e92873e9-da43-42e7-b5a0-f75c212d2555 tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1.info" returned: 0 in 0.657s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e92873e9-da43-42e7-b5a0-f75c212d2555 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.379s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.268s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27e5000c-b22e-4004-b3cf-2ad64214a2d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14cc1a653c7a450284718964239e2f9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:09Z,use_quota=True,user_id='e965a25f18d84c92b87ab7ca1149c4f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Creating volume 27e5000c-b22e-4004-b3cf-2ad64214a2d3 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:20 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:47:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:20 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3 1073741824 Jul 06 15:47:20 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:20 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-e92873e9-da43-42e7-b5a0-f75c212d2555 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Create snapshot completed successfully Jul 06 15:47:20 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-74b2288a-c76b-4fe3-b247-f36f8ff6e53b tempest-CreateVolumesFromImageTest-170619856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-123ad6cd-6166-40ef-9e2e-b7dbaa7f1056" returned: 0 in 0.696s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:20 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-74b2288a-c76b-4fe3-b247-f36f8ff6e53b tempest-CreateVolumesFromImageTest-170619856 None] Lock "cinder-quobyte-123ad6cd-6166-40ef-9e2e-b7dbaa7f1056" released by "delete_volume" :: held 1.533s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:20 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-74b2288a-c76b-4fe3-b247-f36f8ff6e53b tempest-CreateVolumesFromImageTest-170619856 None] Created reservations ['1177b1ed-77e1-42ee-897d-bf29647567ec', 'de791225-c7fe-4a26-8a5f-5ade97a27ac1', 'e693c759-f024-4167-82c3-65886a9cec41', 'd39a56ae-cbcb-47f2-9cad-d5905d603e3f'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-74b2288a-c76b-4fe3-b247-f36f8ff6e53b tempest-CreateVolumesFromImageTest-170619856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-74b2288a-c76b-4fe3-b247-f36f8ff6e53b tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-74b2288a-c76b-4fe3-b247-f36f8ff6e53b tempest-CreateVolumesFromImageTest-170619856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-74b2288a-c76b-4fe3-b247-f36f8ff6e53b tempest-CreateVolumesFromImageTest-170619856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-74b2288a-c76b-4fe3-b247-f36f8ff6e53b tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-74b2288a-c76b-4fe3-b247-f36f8ff6e53b tempest-CreateVolumesFromImageTest-170619856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:20 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:47:20 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:20 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3 1073741824" returned: 0 in 0.856s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:20 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3 Jul 06 15:47:20 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:21 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f4ce06f0-018f-435c-8fcb-20b4684b9667 tempest-CreateVolumesFromImageTest-170619856 None] Acquiring lock "cinder-d6d31a8e-bd99-4a0f-9fa4-67d752d8415f-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:21 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f4ce06f0-018f-435c-8fcb-20b4684b9667 tempest-CreateVolumesFromImageTest-170619856 None] Lock "cinder-d6d31a8e-bd99-4a0f-9fa4-67d752d8415f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:21 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f4ce06f0-018f-435c-8fcb-20b4684b9667 tempest-CreateVolumesFromImageTest-170619856 None] Acquiring lock "cinder-quobyte-d6d31a8e-bd99-4a0f-9fa4-67d752d8415f" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:21 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f4ce06f0-018f-435c-8fcb-20b4684b9667 tempest-CreateVolumesFromImageTest-170619856 None] Lock "cinder-quobyte-d6d31a8e-bd99-4a0f-9fa4-67d752d8415f" acquired by "delete_volume" :: waited 0.023s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:21 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[302c2ae0-f041-428c-9351-ae1608fb8c9d]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f4ce06f0-018f-435c-8fcb-20b4684b9667 tempest-CreateVolumesFromImageTest-170619856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6d31a8e-bd99-4a0f-9fa4-67d752d8415f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:21 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-74b2288a-c76b-4fe3-b247-f36f8ff6e53b tempest-CreateVolumesFromImageTest-170619856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.700s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:21 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-74b2288a-c76b-4fe3-b247-f36f8ff6e53b tempest-CreateVolumesFromImageTest-170619856 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:21 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-74b2288a-c76b-4fe3-b247-f36f8ff6e53b tempest-CreateVolumesFromImageTest-170619856 None] Deleted volume successfully. Jul 06 15:47:21 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-74b2288a-c76b-4fe3-b247-f36f8ff6e53b tempest-CreateVolumesFromImageTest-170619856 None] Lock "cinder-123ad6cd-6166-40ef-9e2e-b7dbaa7f1056-delete_volume" released by "delete_volume" :: held 2.475s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:21 devstack sudo[104646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6d31a8e-bd99-4a0f-9fa4-67d752d8415f Jul 06 15:47:21 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:21 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3" returned: 0 in 0.812s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.904s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4dd10e-1301-45ef-b824-8a6aadfdefed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f17181d21cd41e59c7032f477c950a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:10Z,use_quota=True,user_id='36d8ef7fd23742eba9730c0eb8134ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67a41747-d914-4940-9a3a-757e7e17f87b),volume_type_id=67a41747-d914-4940-9a3a-757e7e17f87b)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Creating volume 3b4dd10e-1301-45ef-b824-8a6aadfdefed {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:21 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:47:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:21 devstack sudo[104649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed 1073741824 Jul 06 15:47:21 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:21 devstack cinder-volume[86148]: DEBUG cinder.volume.volume_utils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Attempting download of fed4e0cf-d865-461a-a2d6-aef32b6c82c7 ((None, [{'url': 'file:///opt/stack/data/glance/images/fed4e0cf-d865-461a-a2d6-aef32b6c82c7', 'metadata': {}}])) to volume 27e5000c-b22e-4004-b3cf-2ad64214a2d3. {{(pid=86148) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 15:47:21 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Flow 'volume_create_manager' (45d05fd5-33da-4a0d-828d-dfb40e85fa56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86fb2366-70b6-486c-88b5-716f478117c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86fb2366-70b6-486c-88b5-716f478117c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-36222201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f4173f-0dbe-4eb6-8a80-01038cef4503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9bb143185d2458493dd93707b6e7b91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:22Z,use_quota=True,user_id='2accca49c6074d0da2bd01a12ae52ff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f424096-91cf-4f73-9b82-b354123852c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f424096-91cf-4f73-9b82-b354123852c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03539c2b-3da9-469f-8a92-6f4db9f5b981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03539c2b-3da9-469f-8a92-6f4db9f5b981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14f4173f-0dbe-4eb6-8a80-01038cef4503', 'volume_name': 'volume-14f4173f-0dbe-4eb6-8a80-01038cef4503', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ece747-60d3-4537-89a7-1a79574c5f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ece747-60d3-4537-89a7-1a79574c5f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d72cf1e-8340-4b55-bd9a-042c07d55a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:22 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Volume 14f4173f-0dbe-4eb6-8a80-01038cef4503: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14f4173f-0dbe-4eb6-8a80-01038cef4503', 'volume_size': 1} Jul 06 15:47:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:22 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[de225e71-f971-4d35-b8ca-1bb323cf8cc6]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fed4e0cf-d865-461a-a2d6-aef32b6c82c7__leoepdx {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:22 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:22 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fed4e0cf-d865-461a-a2d6-aef32b6c82c7__leoepdx Jul 06 15:47:22 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Flow 'volume_create_manager' (36a90148-7285-42cd-ad7c-8cc590e80f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:22 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0adce77-6d99-430a-95f2-faeefd029b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f4ce06f0-018f-435c-8fcb-20b4684b9667 tempest-CreateVolumesFromImageTest-170619856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6d31a8e-bd99-4a0f-9fa4-67d752d8415f" returned: 0 in 1.128s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f4ce06f0-018f-435c-8fcb-20b4684b9667 tempest-CreateVolumesFromImageTest-170619856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6d31a8e-bd99-4a0f-9fa4-67d752d8415f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0adce77-6d99-430a-95f2-faeefd029b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-483932663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f0d683f-99e2-41b4-933f-3bed57cab4a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9bb143185d2458493dd93707b6e7b91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:22Z,use_quota=True,user_id='2accca49c6074d0da2bd01a12ae52ff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:22 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6d31a8e-bd99-4a0f-9fa4-67d752d8415f Jul 06 15:47:22 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73fbb83c-d69e-4466-b281-22354d1e7690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73fbb83c-d69e-4466-b281-22354d1e7690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f1b7ead-b923-4bfe-8646-e7846dd76297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f1b7ead-b923-4bfe-8646-e7846dd76297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f0d683f-99e2-41b4-933f-3bed57cab4a9', 'volume_name': 'volume-0f0d683f-99e2-41b4-933f-3bed57cab4a9', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (814174a4-0af6-4008-a184-6548d16fe7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (814174a4-0af6-4008-a184-6548d16fe7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c52a5e-ff74-4e16-8e4d-61679fefdeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:22 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Volume 0f0d683f-99e2-41b4-933f-3bed57cab4a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f0d683f-99e2-41b4-933f-3bed57cab4a9', 'volume_size': 1} Jul 06 15:47:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:22 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Flow 'volume_create_manager' (1cccdd49-26ce-454f-9f38-efd208cc5caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:22 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90edfec8-bdce-4d1d-ba94-0a8b65baf897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90edfec8-bdce-4d1d-ba94-0a8b65baf897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-212411625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b85a158f-0b51-4af3-961d-5bb3427fcea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9bb143185d2458493dd93707b6e7b91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:23Z,use_quota=True,user_id='2accca49c6074d0da2bd01a12ae52ff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (389ccb33-6583-4880-8b60-dd768ac41bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:23 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (389ccb33-6583-4880-8b60-dd768ac41bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd85ac2-d38a-49c0-b99c-2e9f52acaf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd85ac2-d38a-49c0-b99c-2e9f52acaf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b85a158f-0b51-4af3-961d-5bb3427fcea2', 'volume_name': 'volume-b85a158f-0b51-4af3-961d-5bb3427fcea2', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0bedcd-0f03-4a98-aa2f-d98799d81746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0bedcd-0f03-4a98-aa2f-d98799d81746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f47ea5-18ef-44b2-a224-919f9164fba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:23 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Volume b85a158f-0b51-4af3-961d-5bb3427fcea2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b85a158f-0b51-4af3-961d-5bb3427fcea2', 'volume_size': 1} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed 1073741824" returned: 0 in 1.287s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:23 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fed4e0cf-d865-461a-a2d6-aef32b6c82c7__leoepdx" returned: 0 in 1.036s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fed4e0cf-d865-461a-a2d6-aef32b6c82c7__leoepdx {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:23 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed Jul 06 15:47:23 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:23 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f4ce06f0-018f-435c-8fcb-20b4684b9667 tempest-CreateVolumesFromImageTest-170619856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d6d31a8e-bd99-4a0f-9fa4-67d752d8415f" returned: 0 in 0.935s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f4ce06f0-018f-435c-8fcb-20b4684b9667 tempest-CreateVolumesFromImageTest-170619856 None] Lock "cinder-quobyte-d6d31a8e-bd99-4a0f-9fa4-67d752d8415f" released by "delete_volume" :: held 2.140s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:23 devstack sudo[104664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fed4e0cf-d865-461a-a2d6-aef32b6c82c7__leoepdx Jul 06 15:47:23 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-f4ce06f0-018f-435c-8fcb-20b4684b9667 tempest-CreateVolumesFromImageTest-170619856 None] Created reservations ['722b07df-b0c6-4421-9e76-165926c5c6e3', '2e312a19-a206-4925-934d-cae2ce8ee123', 'e70e11e5-d0c9-4612-8bdc-e3f8140491a6', '756ccca6-4f92-4897-a901-c9b3b7e63f95'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Flow 'volume_create_manager' (009ccea9-8652-4ec9-956d-e81dee7385c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6991f505-d833-48e5-9d4f-56fb2012387e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f4ce06f0-018f-435c-8fcb-20b4684b9667 tempest-CreateVolumesFromImageTest-170619856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f4ce06f0-018f-435c-8fcb-20b4684b9667 tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f4ce06f0-018f-435c-8fcb-20b4684b9667 tempest-CreateVolumesFromImageTest-170619856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f4ce06f0-018f-435c-8fcb-20b4684b9667 tempest-CreateVolumesFromImageTest-170619856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f4ce06f0-018f-435c-8fcb-20b4684b9667 tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f4ce06f0-018f-435c-8fcb-20b4684b9667 tempest-CreateVolumesFromImageTest-170619856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6991f505-d833-48e5-9d4f-56fb2012387e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-339847120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a844ca-5bfa-4ee9-9838-2b9fcf86f1d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9bb143185d2458493dd93707b6e7b91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:23Z,use_quota=True,user_id='2accca49c6074d0da2bd01a12ae52ff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ba66f9-2f07-48bc-a9cb-42936219b307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ba66f9-2f07-48bc-a9cb-42936219b307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a203ac81-9546-468e-b54e-90d5a6b3ed44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:23 devstack sudo[104668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:47:23 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a203ac81-9546-468e-b54e-90d5a6b3ed44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3a844ca-5bfa-4ee9-9838-2b9fcf86f1d8', 'volume_name': 'volume-d3a844ca-5bfa-4ee9-9838-2b9fcf86f1d8', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52da31db-39c3-46bc-a2c5-991b22bc1401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52da31db-39c3-46bc-a2c5-991b22bc1401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff3a2b7-804c-4c0e-8607-6e5dc95f34e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:23 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Volume d3a844ca-5bfa-4ee9-9838-2b9fcf86f1d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3a844ca-5bfa-4ee9-9838-2b9fcf86f1d8', 'volume_size': 1} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:23 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed" returned: 0 in 0.852s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] <== create_volume: return (2209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.216s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.930s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-36222201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f4173f-0dbe-4eb6-8a80-01038cef4503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9bb143185d2458493dd93707b6e7b91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:22Z,use_quota=True,user_id='2accca49c6074d0da2bd01a12ae52ff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Creating volume 14f4173f-0dbe-4eb6-8a80-01038cef4503 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:24 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-14f4173f-0dbe-4eb6-8a80-01038cef4503 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:24 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-14f4173f-0dbe-4eb6-8a80-01038cef4503 1073741824 Jul 06 15:47:24 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG cinder.volume.volume_utils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Attempting download of bcf4ae79-0b81-42d0-b1e5-e464d82ff031 ((None, [{'url': 'file:///opt/stack/data/glance/images/bcf4ae79-0b81-42d0-b1e5-e464d82ff031', 'metadata': {}}])) to volume 3b4dd10e-1301-45ef-b824-8a6aadfdefed. {{(pid=86148) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:24 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Flow 'volume_create_manager' (c217e97f-4eeb-40ce-b0ff-1a07f75c04eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90415b4e-ff71-4c3e-b3ba-2c4d56802b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fed4e0cf-d865-461a-a2d6-aef32b6c82c7__leoepdx" returned: 1 in 1.042s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fed4e0cf-d865-461a-a2d6-aef32b6c82c7__leoepdx' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[311171a0-0f78-48b7-bef4-d5c328ce45ba]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fed4e0cf-d865-461a-a2d6-aef32b6c82c7_44b_9twpdevstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dfa876-5fa5-4357-b999-f51d2cdf6e3a]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90415b4e-ff71-4c3e-b3ba-2c4d56802b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2141726583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be21208-1c89-46b5-9c0c-050ae40b3581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9bb143185d2458493dd93707b6e7b91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:24Z,use_quota=True,user_id='2accca49c6074d0da2bd01a12ae52ff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (657fa67d-0a7a-43ed-af6f-e2d2ad2adf12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (657fa67d-0a7a-43ed-af6f-e2d2ad2adf12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e756d4-5c30-489b-8734-c84b81d849b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e756d4-5c30-489b-8734-c84b81d849b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1be21208-1c89-46b5-9c0c-050ae40b3581', 'volume_name': 'volume-1be21208-1c89-46b5-9c0c-050ae40b3581', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7fe0d6f-4c35-4326-902f-4c19ad53ae20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7fe0d6f-4c35-4326-902f-4c19ad53ae20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d8f7297-5e31-45e8-be6a-c6c4e14dbd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:24 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Volume 1be21208-1c89-46b5-9c0c-050ae40b3581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1be21208-1c89-46b5-9c0c-050ae40b3581', 'volume_size': 1} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_btd2dc3v {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:24 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fed4e0cf-d865-461a-a2d6-aef32b6c82c7_44b_9twpdevstack@QuobyteHD Jul 06 15:47:24 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:24 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_btd2dc3v Jul 06 15:47:24 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:24 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f4ce06f0-018f-435c-8fcb-20b4684b9667 tempest-CreateVolumesFromImageTest-170619856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.831s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-f4ce06f0-018f-435c-8fcb-20b4684b9667 tempest-CreateVolumesFromImageTest-170619856 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:24 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-f4ce06f0-018f-435c-8fcb-20b4684b9667 tempest-CreateVolumesFromImageTest-170619856 None] Deleted volume successfully. Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f4ce06f0-018f-435c-8fcb-20b4684b9667 tempest-CreateVolumesFromImageTest-170619856 None] Lock "cinder-d6d31a8e-bd99-4a0f-9fa4-67d752d8415f-delete_volume" released by "delete_volume" :: held 3.409s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8a7f7f87-e91c-41b1-b50a-1f857ff94677 tempest-CreateVolumesFromImageTest-170619856 None] Acquiring lock "cinder-b827f316-4c48-498b-8f30-2843addf99ce-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8a7f7f87-e91c-41b1-b50a-1f857ff94677 tempest-CreateVolumesFromImageTest-170619856 None] Lock "cinder-b827f316-4c48-498b-8f30-2843addf99ce-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8a7f7f87-e91c-41b1-b50a-1f857ff94677 tempest-CreateVolumesFromImageTest-170619856 None] Acquiring lock "cinder-quobyte-b827f316-4c48-498b-8f30-2843addf99ce" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8a7f7f87-e91c-41b1-b50a-1f857ff94677 tempest-CreateVolumesFromImageTest-170619856 None] Lock "cinder-quobyte-b827f316-4c48-498b-8f30-2843addf99ce" acquired by "delete_volume" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d663f4-3e41-4abd-800f-1360acd7e02c]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8a7f7f87-e91c-41b1-b50a-1f857ff94677 tempest-CreateVolumesFromImageTest-170619856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b827f316-4c48-498b-8f30-2843addf99ce {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:24 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b827f316-4c48-498b-8f30-2843addf99ce Jul 06 15:47:24 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:25 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-14f4173f-0dbe-4eb6-8a80-01038cef4503 1073741824" returned: 0 in 0.993s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-14f4173f-0dbe-4eb6-8a80-01038cef4503 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:25 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-14f4173f-0dbe-4eb6-8a80-01038cef4503 Jul 06 15:47:25 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:25 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fed4e0cf-d865-461a-a2d6-aef32b6c82c7_44b_9twpdevstack@QuobyteHD" returned: 0 in 0.927s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fed4e0cf-d865-461a-a2d6-aef32b6c82c7_44b_9twpdevstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:25 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fed4e0cf-d865-461a-a2d6-aef32b6c82c7_44b_9twpdevstack@QuobyteHD Jul 06 15:47:25 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:25 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_btd2dc3v" returned: 0 in 1.006s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_btd2dc3v {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:25 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_btd2dc3v Jul 06 15:47:25 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:25 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8a7f7f87-e91c-41b1-b50a-1f857ff94677 tempest-CreateVolumesFromImageTest-170619856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b827f316-4c48-498b-8f30-2843addf99ce" returned: 0 in 0.890s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8a7f7f87-e91c-41b1-b50a-1f857ff94677 tempest-CreateVolumesFromImageTest-170619856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b827f316-4c48-498b-8f30-2843addf99ce {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:25 devstack sudo[104700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b827f316-4c48-498b-8f30-2843addf99ce Jul 06 15:47:25 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:25 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-14f4173f-0dbe-4eb6-8a80-01038cef4503" returned: 0 in 0.703s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.408s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-483932663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f0d683f-99e2-41b4-933f-3bed57cab4a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9bb143185d2458493dd93707b6e7b91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:22Z,use_quota=True,user_id='2accca49c6074d0da2bd01a12ae52ff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Creating volume 0f0d683f-99e2-41b4-933f-3bed57cab4a9 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:25 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0f0d683f-99e2-41b4-933f-3bed57cab4a9 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:25 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0f0d683f-99e2-41b4-933f-3bed57cab4a9 1073741824 Jul 06 15:47:25 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d72cf1e-8340-4b55-bd9a-042c07d55a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14f4173f-0dbe-4eb6-8a80-01038cef4503', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39117e5e-6efd-42e1-99e7-23a57981cf2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:25 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Volume volume-14f4173f-0dbe-4eb6-8a80-01038cef4503 (14f4173f-0dbe-4eb6-8a80-01038cef4503): created successfully Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39117e5e-6efd-42e1-99e7-23a57981cf2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Flow 'volume_create_manager' (45d05fd5-33da-4a0d-828d-dfb40e85fa56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:25 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-f317e8d6-2fb5-4f77-a82e-f9d6b527a352 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Created volume successfully. Jul 06 15:47:25 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fed4e0cf-d865-461a-a2d6-aef32b6c82c7_44b_9twpdevstack@QuobyteHD" returned: 1 in 0.816s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fed4e0cf-d865-461a-a2d6-aef32b6c82c7_44b_9twpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] fed4e0cf-d865-461a-a2d6-aef32b6c82c7 was raw, converting to raw {{(pid=86148) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 15:47:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fed4e0cf-d865-461a-a2d6-aef32b6c82c7_44b_9twpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:25 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fed4e0cf-d865-461a-a2d6-aef32b6c82c7_44b_9twpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3 Jul 06 15:47:25 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:26 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_btd2dc3v" returned: 1 in 0.859s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_btd2dc3v' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:47:26 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fd96ed-fa8a-4f64-8f03-8eb62cb87f10]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_5w2pruy7devstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:26 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_5w2pruy7devstack@QuobyteHD Jul 06 15:47:26 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:26 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8a7f7f87-e91c-41b1-b50a-1f857ff94677 tempest-CreateVolumesFromImageTest-170619856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b827f316-4c48-498b-8f30-2843addf99ce" returned: 0 in 0.778s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8a7f7f87-e91c-41b1-b50a-1f857ff94677 tempest-CreateVolumesFromImageTest-170619856 None] Lock "cinder-quobyte-b827f316-4c48-498b-8f30-2843addf99ce" released by "delete_volume" :: held 1.729s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:26 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-8a7f7f87-e91c-41b1-b50a-1f857ff94677 tempest-CreateVolumesFromImageTest-170619856 None] Created reservations ['ecd91130-6fe1-4231-96ef-400bd8f94059', '3e73d5c7-bb53-45d3-b33d-16d8a257155b', '0fa10336-cd12-4f24-a786-4c7c7bc1915f', '184ead14-6bb0-4ac8-9b32-b93b78d825ed'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8a7f7f87-e91c-41b1-b50a-1f857ff94677 tempest-CreateVolumesFromImageTest-170619856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8a7f7f87-e91c-41b1-b50a-1f857ff94677 tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:26 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-8a7f7f87-e91c-41b1-b50a-1f857ff94677 tempest-CreateVolumesFromImageTest-170619856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:26 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-8a7f7f87-e91c-41b1-b50a-1f857ff94677 tempest-CreateVolumesFromImageTest-170619856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8a7f7f87-e91c-41b1-b50a-1f857ff94677 tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8a7f7f87-e91c-41b1-b50a-1f857ff94677 tempest-CreateVolumesFromImageTest-170619856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:26 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:47:26 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:26 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fed4e0cf-d865-461a-a2d6-aef32b6c82c7_44b_9twpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3" returned: 0 in 0.845s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:26 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:26 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fed4e0cf-d865-461a-a2d6-aef32b6c82c7_44b_9twpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3 {{(pid=86148) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:47:26 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 15:47:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0f0d683f-99e2-41b4-933f-3bed57cab4a9 1073741824" returned: 0 in 1.010s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:26 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3 1G Jul 06 15:47:26 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d1eae0cc-fc6a-46a1-a273-28b7e376e2cf tempest-CreateVolumesFromImageTest-170619856 None] Acquiring lock "cinder-32f854df-a315-4890-a0cb-0e898ab16d4e-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d1eae0cc-fc6a-46a1-a273-28b7e376e2cf tempest-CreateVolumesFromImageTest-170619856 None] Lock "cinder-32f854df-a315-4890-a0cb-0e898ab16d4e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0f0d683f-99e2-41b4-933f-3bed57cab4a9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:26 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0f0d683f-99e2-41b4-933f-3bed57cab4a9 Jul 06 15:47:26 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d1eae0cc-fc6a-46a1-a273-28b7e376e2cf tempest-CreateVolumesFromImageTest-170619856 None] Acquiring lock "cinder-quobyte-32f854df-a315-4890-a0cb-0e898ab16d4e" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d1eae0cc-fc6a-46a1-a273-28b7e376e2cf tempest-CreateVolumesFromImageTest-170619856 None] Lock "cinder-quobyte-32f854df-a315-4890-a0cb-0e898ab16d4e" acquired by "delete_volume" :: waited 0.017s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:26 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cf596e-3e0e-4565-a5e4-89d92faeab1e]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d1eae0cc-fc6a-46a1-a273-28b7e376e2cf tempest-CreateVolumesFromImageTest-170619856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-32f854df-a315-4890-a0cb-0e898ab16d4e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:27 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_5w2pruy7devstack@QuobyteHD" returned: 0 in 0.971s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_5w2pruy7devstack@QuobyteHD {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:27 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-32f854df-a315-4890-a0cb-0e898ab16d4e Jul 06 15:47:27 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:27 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_5w2pruy7devstack@QuobyteHD Jul 06 15:47:27 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:27 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8a7f7f87-e91c-41b1-b50a-1f857ff94677 tempest-CreateVolumesFromImageTest-170619856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.916s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:27 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-8a7f7f87-e91c-41b1-b50a-1f857ff94677 tempest-CreateVolumesFromImageTest-170619856 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:27 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-8a7f7f87-e91c-41b1-b50a-1f857ff94677 tempest-CreateVolumesFromImageTest-170619856 None] Deleted volume successfully. Jul 06 15:47:27 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8a7f7f87-e91c-41b1-b50a-1f857ff94677 tempest-CreateVolumesFromImageTest-170619856 None] Lock "cinder-b827f316-4c48-498b-8f30-2843addf99ce-delete_volume" released by "delete_volume" :: held 2.934s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:27 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3 1G" returned: 0 in 0.825s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:27 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee5cbde-2ed2-47a2-aa6f-69994e79c7ef]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:27 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3 Jul 06 15:47:27 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:27 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0f0d683f-99e2-41b4-933f-3bed57cab4a9" returned: 0 in 0.991s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:27 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] <== create_volume: return (2091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.095s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.774s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:27 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-212411625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b85a158f-0b51-4af3-961d-5bb3427fcea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9bb143185d2458493dd93707b6e7b91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:23Z,use_quota=True,user_id='2accca49c6074d0da2bd01a12ae52ff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:27 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Creating volume b85a158f-0b51-4af3-961d-5bb3427fcea2 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:27 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:27 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:27 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:27 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:47:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b85a158f-0b51-4af3-961d-5bb3427fcea2 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:27 devstack sudo[104743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b85a158f-0b51-4af3-961d-5bb3427fcea2 1073741824 Jul 06 15:47:27 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:27 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c52a5e-ff74-4e16-8e4d-61679fefdeef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f0d683f-99e2-41b4-933f-3bed57cab4a9', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:27 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba294e5-7336-4723-addf-88fcfbc523f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:27 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Volume volume-0f0d683f-99e2-41b4-933f-3bed57cab4a9 (0f0d683f-99e2-41b4-933f-3bed57cab4a9): created successfully Jul 06 15:47:27 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba294e5-7336-4723-addf-88fcfbc523f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:27 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Flow 'volume_create_manager' (36a90148-7285-42cd-ad7c-8cc590e80f91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:28 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-e4653d27-fbf4-436a-a788-71b6f859de88 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Created volume successfully. Jul 06 15:47:28 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d1eae0cc-fc6a-46a1-a273-28b7e376e2cf tempest-CreateVolumesFromImageTest-170619856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-32f854df-a315-4890-a0cb-0e898ab16d4e" returned: 0 in 1.090s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d1eae0cc-fc6a-46a1-a273-28b7e376e2cf tempest-CreateVolumesFromImageTest-170619856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-32f854df-a315-4890-a0cb-0e898ab16d4e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:28 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_5w2pruy7devstack@QuobyteHD" returned: 1 in 1.002s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_5w2pruy7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:47:28 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] bcf4ae79-0b81-42d0-b1e5-e464d82ff031 was raw, converting to raw {{(pid=86148) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 15:47:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_5w2pruy7devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:28 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-32f854df-a315-4890-a0cb-0e898ab16d4e Jul 06 15:47:28 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:28 devstack sudo[104750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_5w2pruy7devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed Jul 06 15:47:28 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:28 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3" returned: 0 in 0.901s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:28 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3 Jul 06 15:47:28 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:28 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d1eae0cc-fc6a-46a1-a273-28b7e376e2cf tempest-CreateVolumesFromImageTest-170619856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-32f854df-a315-4890-a0cb-0e898ab16d4e" returned: 0 in 0.735s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:28 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d1eae0cc-fc6a-46a1-a273-28b7e376e2cf tempest-CreateVolumesFromImageTest-170619856 None] Lock "cinder-quobyte-32f854df-a315-4890-a0cb-0e898ab16d4e" released by "delete_volume" :: held 1.871s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:28 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-d1eae0cc-fc6a-46a1-a273-28b7e376e2cf tempest-CreateVolumesFromImageTest-170619856 None] Created reservations ['6c352724-807d-400c-ad79-ac22a01c37d2', '358923f6-c47b-4f6a-994b-b1b8d7d96501', '2ee707dd-0890-4ffc-b70d-f17e047c4a3f', '326a4c82-1cba-4809-baca-9ad87a08b1ad'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:28 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b85a158f-0b51-4af3-961d-5bb3427fcea2 1073741824" returned: 0 in 1.060s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d1eae0cc-fc6a-46a1-a273-28b7e376e2cf tempest-CreateVolumesFromImageTest-170619856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d1eae0cc-fc6a-46a1-a273-28b7e376e2cf tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:28 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d1eae0cc-fc6a-46a1-a273-28b7e376e2cf tempest-CreateVolumesFromImageTest-170619856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:28 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d1eae0cc-fc6a-46a1-a273-28b7e376e2cf tempest-CreateVolumesFromImageTest-170619856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d1eae0cc-fc6a-46a1-a273-28b7e376e2cf tempest-CreateVolumesFromImageTest-170619856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d1eae0cc-fc6a-46a1-a273-28b7e376e2cf tempest-CreateVolumesFromImageTest-170619856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b85a158f-0b51-4af3-961d-5bb3427fcea2 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:29 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:47:29 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:29 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b85a158f-0b51-4af3-961d-5bb3427fcea2 Jul 06 15:47:29 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:29 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_5w2pruy7devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed" returned: 0 in 1.020s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bcf4ae79-0b81-42d0-b1e5-e464d82ff031_5w2pruy7devstack@QuobyteHD, size 0.00 MB, duration 1.02 sec, destination /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed {{(pid=86148) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:47:29 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:29 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed 1G Jul 06 15:47:29 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:29 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3" returned: 1 in 1.007s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG cinder.volume.volume_utils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Downloaded image fed4e0cf-d865-461a-a2d6-aef32b6c82c7 ((None, [{'url': 'file:///opt/stack/data/glance/images/fed4e0cf-d865-461a-a2d6-aef32b6c82c7', 'metadata': {}}])) to volume 27e5000c-b22e-4004-b3cf-2ad64214a2d3 successfully. {{(pid=86148) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Temporary image fed4e0cf-d865-461a-a2d6-aef32b6c82c7 for user e965a25f18d84c92b87ab7ca1149c4f5 is deleted. {{(pid=86148) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG cinder.volume.volume_utils [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Marking volume 27e5000c-b22e-4004-b3cf-2ad64214a2d3 as bootable. {{(pid=86148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Copying metadata from image fed4e0cf-d865-461a-a2d6-aef32b6c82c7 to 27e5000c-b22e-4004-b3cf-2ad64214a2d3. {{(pid=86148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Creating volume glance metadata for volume 27e5000c-b22e-4004-b3cf-2ad64214a2d3 backed by image fed4e0cf-d865-461a-a2d6-aef32b6c82c7 with: {'image_id': 'fed4e0cf-d865-461a-a2d6-aef32b6c82c7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0c4fac96284a688474774f9cdd9e9c26', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86148) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fb2bbf-c1b7-433f-a150-844248299da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3', 'volume_size': 1, 'image_id': 'fed4e0cf-d865-461a-a2d6-aef32b6c82c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fed4e0cf-d865-461a-a2d6-aef32b6c82c7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0c4fac96284a688474774f9cdd9e9c26', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '14cc1a653c7a450284718964239e2f9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8c6c97ffb8db8e061a2bbaba6c73911969b780e2246e2c84a7a2ad5800d4f11234db9c12c5a83442013ccd9bad94260ed72508069b9ac429fde1b9097ca1bd8d', 'id': 'fed4e0cf-d865-461a-a2d6-aef32b6c82c7', 'created_at': datetime.datetime(2026, 7, 6, 13, 47, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 47, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fed4e0cf-d865-461a-a2d6-aef32b6c82c7/file', 'properties': {}}, 'image_service': }' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0fa03f0-4752-4f57-9d11-76807182047c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:29 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Volume volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3 (27e5000c-b22e-4004-b3cf-2ad64214a2d3): created successfully Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0fa03f0-4752-4f57-9d11-76807182047c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Flow 'volume_create_manager' (f3d68bf5-d54d-46a0-9125-4c1997be5f18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:29 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-ff8cf59c-6d24-432f-938c-9664146d7f6f tempest-VolumeImageDependencyTests-1401822160 None] Created volume successfully. Jul 06 15:47:29 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d1eae0cc-fc6a-46a1-a273-28b7e376e2cf tempest-CreateVolumesFromImageTest-170619856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.884s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-d1eae0cc-fc6a-46a1-a273-28b7e376e2cf tempest-CreateVolumesFromImageTest-170619856 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:29 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-d1eae0cc-fc6a-46a1-a273-28b7e376e2cf tempest-CreateVolumesFromImageTest-170619856 None] Deleted volume successfully. Jul 06 15:47:29 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b85a158f-0b51-4af3-961d-5bb3427fcea2" returned: 0 in 0.886s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] <== create_volume: return (2017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.020s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.258s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-339847120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a844ca-5bfa-4ee9-9838-2b9fcf86f1d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9bb143185d2458493dd93707b6e7b91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:23Z,use_quota=True,user_id='2accca49c6074d0da2bd01a12ae52ff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Creating volume d3a844ca-5bfa-4ee9-9838-2b9fcf86f1d8 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:29 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3a844ca-5bfa-4ee9-9838-2b9fcf86f1d8 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:29 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3a844ca-5bfa-4ee9-9838-2b9fcf86f1d8 1073741824 Jul 06 15:47:29 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d1eae0cc-fc6a-46a1-a273-28b7e376e2cf tempest-CreateVolumesFromImageTest-170619856 None] Lock "cinder-32f854df-a315-4890-a0cb-0e898ab16d4e-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f47ea5-18ef-44b2-a224-919f9164fba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b85a158f-0b51-4af3-961d-5bb3427fcea2', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (025ddcf8-f407-4f8b-b425-47d3aa72af4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:29 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Volume volume-b85a158f-0b51-4af3-961d-5bb3427fcea2 (b85a158f-0b51-4af3-961d-5bb3427fcea2): created successfully Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (025ddcf8-f407-4f8b-b425-47d3aa72af4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:29 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Flow 'volume_create_manager' (1cccdd49-26ce-454f-9f38-efd208cc5caa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:29 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-1c7a31c0-2172-4b29-ac51-981c40a9aea9 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Created volume successfully. Jul 06 15:47:30 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed 1G" returned: 0 in 0.917s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:30 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[339ef1d9-b36c-4930-9e23-aa4d9c2f90b8]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:30 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed Jul 06 15:47:30 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:30 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed" returned: 0 in 0.867s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:30 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3a844ca-5bfa-4ee9-9838-2b9fcf86f1d8 1073741824" returned: 0 in 1.056s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:30 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-72f56b9f-4522-434a-ad16-f0e90f6e01e8 tempest-VolumeImageDependencyTests-1401822160 None] Acquiring lock "cinder-27e5000c-b22e-4004-b3cf-2ad64214a2d3-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-72f56b9f-4522-434a-ad16-f0e90f6e01e8 tempest-VolumeImageDependencyTests-1401822160 None] Lock "cinder-27e5000c-b22e-4004-b3cf-2ad64214a2d3-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3a844ca-5bfa-4ee9-9838-2b9fcf86f1d8 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:31 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed Jul 06 15:47:31 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:31 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3a844ca-5bfa-4ee9-9838-2b9fcf86f1d8 Jul 06 15:47:31 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-72f56b9f-4522-434a-ad16-f0e90f6e01e8 tempest-VolumeImageDependencyTests-1401822160 None] Acquiring lock "cinder-quobyte-27e5000c-b22e-4004-b3cf-2ad64214a2d3" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-72f56b9f-4522-434a-ad16-f0e90f6e01e8 tempest-VolumeImageDependencyTests-1401822160 None] Lock "cinder-quobyte-27e5000c-b22e-4004-b3cf-2ad64214a2d3" acquired by "delete_volume" :: waited 0.054s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e247d0-3750-4278-88d9-1061ec0eba50]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-72f56b9f-4522-434a-ad16-f0e90f6e01e8 tempest-VolumeImageDependencyTests-1401822160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:31 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3 Jul 06 15:47:31 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:31 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed" returned: 1 in 0.869s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG cinder.volume.volume_utils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Downloaded image bcf4ae79-0b81-42d0-b1e5-e464d82ff031 ((None, [{'url': 'file:///opt/stack/data/glance/images/bcf4ae79-0b81-42d0-b1e5-e464d82ff031', 'metadata': {}}])) to volume 3b4dd10e-1301-45ef-b824-8a6aadfdefed successfully. {{(pid=86148) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Temporary image bcf4ae79-0b81-42d0-b1e5-e464d82ff031 for user 36d8ef7fd23742eba9730c0eb8134ea9 is deleted. {{(pid=86148) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG cinder.volume.volume_utils [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Marking volume 3b4dd10e-1301-45ef-b824-8a6aadfdefed as bootable. {{(pid=86148) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Copying metadata from image bcf4ae79-0b81-42d0-b1e5-e464d82ff031 to 3b4dd10e-1301-45ef-b824-8a6aadfdefed. {{(pid=86148) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Creating volume glance metadata for volume 3b4dd10e-1301-45ef-b824-8a6aadfdefed backed by image bcf4ae79-0b81-42d0-b1e5-e464d82ff031 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'bcf4ae79-0b81-42d0-b1e5-e464d82ff031', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '66f8d2b46b296f8aced50d19b8f024ab', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86148) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 15:47:31 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3a844ca-5bfa-4ee9-9838-2b9fcf86f1d8" returned: 0 in 0.801s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.967s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.630s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2141726583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be21208-1c89-46b5-9c0c-050ae40b3581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9bb143185d2458493dd93707b6e7b91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:24Z,use_quota=True,user_id='2accca49c6074d0da2bd01a12ae52ff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Creating volume 1be21208-1c89-46b5-9c0c-050ae40b3581 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:31 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1be21208-1c89-46b5-9c0c-050ae40b3581 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:31 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1be21208-1c89-46b5-9c0c-050ae40b3581 1073741824 Jul 06 15:47:31 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff3a2b7-804c-4c0e-8607-6e5dc95f34e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3a844ca-5bfa-4ee9-9838-2b9fcf86f1d8', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112f3f52-2860-49b9-b682-ea402cff4ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:31 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Volume volume-d3a844ca-5bfa-4ee9-9838-2b9fcf86f1d8 (d3a844ca-5bfa-4ee9-9838-2b9fcf86f1d8): created successfully Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112f3f52-2860-49b9-b682-ea402cff4ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Flow 'volume_create_manager' (009ccea9-8652-4ec9-956d-e81dee7385c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:31 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee71741-ef43-4895-9d2b-a76115d57d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed', 'volume_size': 1, 'image_id': 'bcf4ae79-0b81-42d0-b1e5-e464d82ff031', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bcf4ae79-0b81-42d0-b1e5-e464d82ff031', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '66f8d2b46b296f8aced50d19b8f024ab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1f17181d21cd41e59c7032f477c950a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '64d9d0cc20e199503ee5b5e380f5eac1332226ef3a543c8b206c4cd5169fef606a4190f557f7ae825eef2ebacaa5d644283a4c294b9340c1cc2fd45342b43f82', 'id': 'bcf4ae79-0b81-42d0-b1e5-e464d82ff031', 'created_at': datetime.datetime(2026, 7, 6, 13, 47, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 47, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bcf4ae79-0b81-42d0-b1e5-e464d82ff031/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6945d91c-87c8-4979-9aae-c8060290de69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:32 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-ea7ba8d1-d2a6-4f14-8aed-e7f22de4dabd tempest-CreateVolumesFromSnapshotTest-1262682818 None] Created volume successfully. Jul 06 15:47:32 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Volume volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed (3b4dd10e-1301-45ef-b824-8a6aadfdefed): created successfully Jul 06 15:47:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6945d91c-87c8-4979-9aae-c8060290de69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Flow 'volume_create_manager' (0a674b10-387e-4ebb-ad12-4f8943b65852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:32 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-d51346e9-faf5-4196-9199-b81e8eafdc9d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Created volume successfully. Jul 06 15:47:32 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-72f56b9f-4522-434a-ad16-f0e90f6e01e8 tempest-VolumeImageDependencyTests-1401822160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3" returned: 0 in 0.859s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-72f56b9f-4522-434a-ad16-f0e90f6e01e8 tempest-VolumeImageDependencyTests-1401822160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:32 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3 Jul 06 15:47:32 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:32 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1be21208-1c89-46b5-9c0c-050ae40b3581 1073741824" returned: 0 in 0.954s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1be21208-1c89-46b5-9c0c-050ae40b3581 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:32 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-72f56b9f-4522-434a-ad16-f0e90f6e01e8 tempest-VolumeImageDependencyTests-1401822160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3" returned: 1 in 0.807s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-72f56b9f-4522-434a-ad16-f0e90f6e01e8 tempest-VolumeImageDependencyTests-1401822160 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:47:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-72f56b9f-4522-434a-ad16-f0e90f6e01e8 tempest-VolumeImageDependencyTests-1401822160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:32 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1be21208-1c89-46b5-9c0c-050ae40b3581 Jul 06 15:47:32 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:32 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3 Jul 06 15:47:32 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:33 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b1b06940-fdf0-4c88-8f87-7ac60dd9bc5d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Acquiring lock "cinder-3b4dd10e-1301-45ef-b824-8a6aadfdefed-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:33 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b1b06940-fdf0-4c88-8f87-7ac60dd9bc5d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Lock "cinder-3b4dd10e-1301-45ef-b824-8a6aadfdefed-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:33 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b1b06940-fdf0-4c88-8f87-7ac60dd9bc5d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Acquiring lock "cinder-quobyte-3b4dd10e-1301-45ef-b824-8a6aadfdefed" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:33 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b1b06940-fdf0-4c88-8f87-7ac60dd9bc5d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Lock "cinder-quobyte-3b4dd10e-1301-45ef-b824-8a6aadfdefed" acquired by "delete_volume" :: waited 0.020s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:33 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c283073-1e5b-4615-b650-830ad45d8476]: (4, 'raw') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b1b06940-fdf0-4c88-8f87-7ac60dd9bc5d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:33 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed Jul 06 15:47:33 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:33 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-72f56b9f-4522-434a-ad16-f0e90f6e01e8 tempest-VolumeImageDependencyTests-1401822160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-27e5000c-b22e-4004-b3cf-2ad64214a2d3" returned: 0 in 0.709s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:33 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-72f56b9f-4522-434a-ad16-f0e90f6e01e8 tempest-VolumeImageDependencyTests-1401822160 None] Lock "cinder-quobyte-27e5000c-b22e-4004-b3cf-2ad64214a2d3" released by "delete_volume" :: held 2.482s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:33 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:33 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-72f56b9f-4522-434a-ad16-f0e90f6e01e8 tempest-VolumeImageDependencyTests-1401822160 None] Created reservations ['3fac815c-a26c-482f-a403-63e65fd28bfd', 'bc171368-0ab3-480c-bbde-0da47f47bcc9', '2c3d05e5-c478-43e2-8692-371cebbbff53', 'ea054e3f-6d41-45a3-b91e-39b3c10b4911'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1be21208-1c89-46b5-9c0c-050ae40b3581" returned: 0 in 0.831s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d8f7297-5e31-45e8-be6a-c6c4e14dbd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1be21208-1c89-46b5-9c0c-050ae40b3581', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa546ff-3a94-42ab-9e97-ec71f392fb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:33 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Volume volume-1be21208-1c89-46b5-9c0c-050ae40b3581 (1be21208-1c89-46b5-9c0c-050ae40b3581): created successfully Jul 06 15:47:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa546ff-3a94-42ab-9e97-ec71f392fb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:33 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Flow 'volume_create_manager' (c217e97f-4eeb-40ce-b0ff-1a07f75c04eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:33 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-377fb754-07d2-40fd-90de-3dd1e00da32f tempest-CreateVolumesFromSnapshotTest-1262682818 None] Created volume successfully. Jul 06 15:47:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-72f56b9f-4522-434a-ad16-f0e90f6e01e8 tempest-VolumeImageDependencyTests-1401822160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-72f56b9f-4522-434a-ad16-f0e90f6e01e8 tempest-VolumeImageDependencyTests-1401822160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-72f56b9f-4522-434a-ad16-f0e90f6e01e8 tempest-VolumeImageDependencyTests-1401822160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-72f56b9f-4522-434a-ad16-f0e90f6e01e8 tempest-VolumeImageDependencyTests-1401822160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-72f56b9f-4522-434a-ad16-f0e90f6e01e8 tempest-VolumeImageDependencyTests-1401822160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-72f56b9f-4522-434a-ad16-f0e90f6e01e8 tempest-VolumeImageDependencyTests-1401822160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:33 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:47:33 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Flow 'volume_create_manager' (75680d80-cd16-4758-8050-f7972280e9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b65ef760-5f80-4ff0-928a-1fd8f3afd6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b65ef760-5f80-4ff0-928a-1fd8f3afd6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-836082894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acae495d-4f57-45a0-8d11-d883379d85d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2acfd7a95ae04e6a8c97cbd4d6771d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:34Z,use_quota=True,user_id='c8e50c716ff74461bb8f1c33607ef860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e050d22f-a9bd-4343-9bc0-9c3be21b4739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e050d22f-a9bd-4343-9bc0-9c3be21b4739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b3f625-bf79-4897-a414-e11cd42e6b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b3f625-bf79-4897-a414-e11cd42e6b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acae495d-4f57-45a0-8d11-d883379d85d3', 'volume_name': 'volume-acae495d-4f57-45a0-8d11-d883379d85d3', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5444191e-a1b7-4e36-bb81-656d7ed66c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5444191e-a1b7-4e36-bb81-656d7ed66c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e10d4d-d339-4441-b094-ccc2ea94657e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:34 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Volume acae495d-4f57-45a0-8d11-d883379d85d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acae495d-4f57-45a0-8d11-d883379d85d3', 'volume_size': 1} Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-836082894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acae495d-4f57-45a0-8d11-d883379d85d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2acfd7a95ae04e6a8c97cbd4d6771d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:34Z,use_quota=True,user_id='c8e50c716ff74461bb8f1c33607ef860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Creating volume acae495d-4f57-45a0-8d11-d883379d85d3 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:34 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:34 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b1b06940-fdf0-4c88-8f87-7ac60dd9bc5d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed" returned: 0 in 0.903s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b1b06940-fdf0-4c88-8f87-7ac60dd9bc5d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:34 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3 1073741824 Jul 06 15:47:34 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:34 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed Jul 06 15:47:34 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-188145c6-e5ef-4e8d-8871-7f4a3ec537ec tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "cinder-1be21208-1c89-46b5-9c0c-050ae40b3581-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-188145c6-e5ef-4e8d-8871-7f4a3ec537ec tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-1be21208-1c89-46b5-9c0c-050ae40b3581-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-188145c6-e5ef-4e8d-8871-7f4a3ec537ec tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "cinder-quobyte-1be21208-1c89-46b5-9c0c-050ae40b3581" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-188145c6-e5ef-4e8d-8871-7f4a3ec537ec tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-quobyte-1be21208-1c89-46b5-9c0c-050ae40b3581" acquired by "delete_volume" :: waited 0.021s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:34 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-72f56b9f-4522-434a-ad16-f0e90f6e01e8 tempest-VolumeImageDependencyTests-1401822160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.779s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-72f56b9f-4522-434a-ad16-f0e90f6e01e8 tempest-VolumeImageDependencyTests-1401822160 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe53846-213b-464d-9627-b223184cd455]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-188145c6-e5ef-4e8d-8871-7f4a3ec537ec tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1be21208-1c89-46b5-9c0c-050ae40b3581 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:34 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-72f56b9f-4522-434a-ad16-f0e90f6e01e8 tempest-VolumeImageDependencyTests-1401822160 None] Deleted volume successfully. Jul 06 15:47:34 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-72f56b9f-4522-434a-ad16-f0e90f6e01e8 tempest-VolumeImageDependencyTests-1401822160 None] Lock "cinder-27e5000c-b22e-4004-b3cf-2ad64214a2d3-delete_volume" released by "delete_volume" :: held 3.648s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:34 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1be21208-1c89-46b5-9c0c-050ae40b3581 Jul 06 15:47:34 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:35 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3 1073741824" returned: 0 in 0.990s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:35 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b1b06940-fdf0-4c88-8f87-7ac60dd9bc5d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed" returned: 1 in 1.004s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b1b06940-fdf0-4c88-8f87-7ac60dd9bc5d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed' failed. Not Retrying. {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:47:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b1b06940-fdf0-4c88-8f87-7ac60dd9bc5d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:35 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed Jul 06 15:47:35 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:35 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3 Jul 06 15:47:35 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:35 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-188145c6-e5ef-4e8d-8871-7f4a3ec537ec tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1be21208-1c89-46b5-9c0c-050ae40b3581" returned: 0 in 0.993s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-188145c6-e5ef-4e8d-8871-7f4a3ec537ec tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1be21208-1c89-46b5-9c0c-050ae40b3581 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:35 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1be21208-1c89-46b5-9c0c-050ae40b3581 Jul 06 15:47:35 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:35 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3" returned: 0 in 0.777s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:35 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e10d4d-d339-4441-b094-ccc2ea94657e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acae495d-4f57-45a0-8d11-d883379d85d3', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc5e5bb-99ef-432b-a2f6-1df9faf45ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:35 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Volume volume-acae495d-4f57-45a0-8d11-d883379d85d3 (acae495d-4f57-45a0-8d11-d883379d85d3): created successfully Jul 06 15:47:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc5e5bb-99ef-432b-a2f6-1df9faf45ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:36 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Flow 'volume_create_manager' (75680d80-cd16-4758-8050-f7972280e9b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b1b06940-fdf0-4c88-8f87-7ac60dd9bc5d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-3b4dd10e-1301-45ef-b824-8a6aadfdefed" returned: 0 in 0.864s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b1b06940-fdf0-4c88-8f87-7ac60dd9bc5d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Lock "cinder-quobyte-3b4dd10e-1301-45ef-b824-8a6aadfdefed" released by "delete_volume" :: held 2.853s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:36 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-0aaf1ec2-70ff-4952-be66-b9dbf75c0ac3 tempest-ProjectMemberTests-765095290 None] Created volume successfully. Jul 06 15:47:36 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-b1b06940-fdf0-4c88-8f87-7ac60dd9bc5d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Created reservations ['9a1ff9c0-8ef3-45f8-a1ad-4a18e5e978b9', 'c29abb53-cdff-4247-8f10-f62d58bb1794', 'd715205d-60c3-423d-9814-f58f10d08085', 'b118b40c-ab6a-4da8-ab13-7de40e502f92'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b1b06940-fdf0-4c88-8f87-7ac60dd9bc5d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b1b06940-fdf0-4c88-8f87-7ac60dd9bc5d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b1b06940-fdf0-4c88-8f87-7ac60dd9bc5d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b1b06940-fdf0-4c88-8f87-7ac60dd9bc5d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b1b06940-fdf0-4c88-8f87-7ac60dd9bc5d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b1b06940-fdf0-4c88-8f87-7ac60dd9bc5d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:36 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:47:36 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:36 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-188145c6-e5ef-4e8d-8871-7f4a3ec537ec tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-1be21208-1c89-46b5-9c0c-050ae40b3581" returned: 0 in 0.891s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-188145c6-e5ef-4e8d-8871-7f4a3ec537ec tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-quobyte-1be21208-1c89-46b5-9c0c-050ae40b3581" released by "delete_volume" :: held 1.969s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:36 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-188145c6-e5ef-4e8d-8871-7f4a3ec537ec tempest-CreateVolumesFromSnapshotTest-1262682818 None] Created reservations ['9370b389-0daa-4d4f-b3f7-8d2c1fb04f39', '0bda316b-c2c2-4ff2-98c2-7ec5f929c496', 'eb8417fa-ca91-4c9f-80d5-86716569ca56', '7013def1-ed28-48a3-a449-397557b45a02'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-188145c6-e5ef-4e8d-8871-7f4a3ec537ec tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-188145c6-e5ef-4e8d-8871-7f4a3ec537ec tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-188145c6-e5ef-4e8d-8871-7f4a3ec537ec tempest-CreateVolumesFromSnapshotTest-1262682818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-188145c6-e5ef-4e8d-8871-7f4a3ec537ec tempest-CreateVolumesFromSnapshotTest-1262682818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-188145c6-e5ef-4e8d-8871-7f4a3ec537ec tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-188145c6-e5ef-4e8d-8871-7f4a3ec537ec tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:36 devstack sudo[104856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:47:36 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-66642e65-2c7c-4bdb-a22c-42d13f725cd7 tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-66642e65-2c7c-4bdb-a22c-42d13f725cd7 tempest-ProjectMemberTests-765095290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-66642e65-2c7c-4bdb-a22c-42d13f725cd7 tempest-ProjectMemberTests-765095290 None] Creating offline snapshot 63fd1490-59fc-4777-978f-0ea7fe126f58 of volume acae495d-4f57-45a0-8d11-d883379d85d3 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:47:37 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[74927b0d-f653-4ae1-a5a5-94c02480ff18]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-66642e65-2c7c-4bdb-a22c-42d13f725cd7 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:37 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3 Jul 06 15:47:37 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:37 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b1b06940-fdf0-4c88-8f87-7ac60dd9bc5d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.151s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:37 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-b1b06940-fdf0-4c88-8f87-7ac60dd9bc5d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:37 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-b1b06940-fdf0-4c88-8f87-7ac60dd9bc5d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Deleted volume successfully. Jul 06 15:47:37 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b1b06940-fdf0-4c88-8f87-7ac60dd9bc5d tempest-VolumeAndVolumeTypeFromImageTest-1755381811 None] Lock "cinder-3b4dd10e-1301-45ef-b824-8a6aadfdefed-delete_volume" released by "delete_volume" :: held 4.285s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:37 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-188145c6-e5ef-4e8d-8871-7f4a3ec537ec tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.917s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:37 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-188145c6-e5ef-4e8d-8871-7f4a3ec537ec tempest-CreateVolumesFromSnapshotTest-1262682818 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:37 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-188145c6-e5ef-4e8d-8871-7f4a3ec537ec tempest-CreateVolumesFromSnapshotTest-1262682818 None] Deleted volume successfully. Jul 06 15:47:37 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-188145c6-e5ef-4e8d-8871-7f4a3ec537ec tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-1be21208-1c89-46b5-9c0c-050ae40b3581-delete_volume" released by "delete_volume" :: held 3.425s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:37 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-66642e65-2c7c-4bdb-a22c-42d13f725cd7 tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3" returned: 0 in 0.875s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-66642e65-2c7c-4bdb-a22c-42d13f725cd7 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3.63fd1490-59fc-4777-978f-0ea7fe126f58 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:37 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d7014593-b918-49dc-8dfb-6949813ab3bc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "cinder-d3a844ca-5bfa-4ee9-9838-2b9fcf86f1d8-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:37 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3.63fd1490-59fc-4777-978f-0ea7fe126f58 1G Jul 06 15:47:37 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:37 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d7014593-b918-49dc-8dfb-6949813ab3bc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-d3a844ca-5bfa-4ee9-9838-2b9fcf86f1d8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d7014593-b918-49dc-8dfb-6949813ab3bc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "cinder-quobyte-d3a844ca-5bfa-4ee9-9838-2b9fcf86f1d8" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d7014593-b918-49dc-8dfb-6949813ab3bc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-quobyte-d3a844ca-5bfa-4ee9-9838-2b9fcf86f1d8" acquired by "delete_volume" :: waited 0.022s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:38 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[6847070d-d039-47c7-b632-344b3c66249e]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d7014593-b918-49dc-8dfb-6949813ab3bc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3a844ca-5bfa-4ee9-9838-2b9fcf86f1d8 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:38 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3a844ca-5bfa-4ee9-9838-2b9fcf86f1d8 Jul 06 15:47:38 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:47:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:38 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:47:38 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:38 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-66642e65-2c7c-4bdb-a22c-42d13f725cd7 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3.63fd1490-59fc-4777-978f-0ea7fe126f58 1G" returned: 0 in 1.091s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-66642e65-2c7c-4bdb-a22c-42d13f725cd7 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acae495d-4f57-45a0-8d11-d883379d85d3 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3.63fd1490-59fc-4777-978f-0ea7fe126f58 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:39 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acae495d-4f57-45a0-8d11-d883379d85d3 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3.63fd1490-59fc-4777-978f-0ea7fe126f58 Jul 06 15:47:39 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:39 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d7014593-b918-49dc-8dfb-6949813ab3bc tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3a844ca-5bfa-4ee9-9838-2b9fcf86f1d8" returned: 0 in 1.112s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d7014593-b918-49dc-8dfb-6949813ab3bc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3a844ca-5bfa-4ee9-9838-2b9fcf86f1d8 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:39 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3a844ca-5bfa-4ee9-9838-2b9fcf86f1d8 Jul 06 15:47:39 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:39 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.095s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:39 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager._thread_info {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:47:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread count: 28 {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:47:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread info: [<_MainThread(MainThread, started 124857273856128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:47:39 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-66642e65-2c7c-4bdb-a22c-42d13f725cd7 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acae495d-4f57-45a0-8d11-d883379d85d3 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3.63fd1490-59fc-4777-978f-0ea7fe126f58" returned: 0 in 0.963s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:39 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-66642e65-2c7c-4bdb-a22c-42d13f725cd7 tempest-ProjectMemberTests-765095290 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3.63fd1490-59fc-4777-978f-0ea7fe126f58 is being set with open permissions: ugo+rw Jul 06 15:47:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-66642e65-2c7c-4bdb-a22c-42d13f725cd7 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3.63fd1490-59fc-4777-978f-0ea7fe126f58 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:39 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3.63fd1490-59fc-4777-978f-0ea7fe126f58 Jul 06 15:47:39 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:40 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d7014593-b918-49dc-8dfb-6949813ab3bc tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d3a844ca-5bfa-4ee9-9838-2b9fcf86f1d8" returned: 0 in 0.851s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:40 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d7014593-b918-49dc-8dfb-6949813ab3bc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-quobyte-d3a844ca-5bfa-4ee9-9838-2b9fcf86f1d8" released by "delete_volume" :: held 2.017s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:40 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-d7014593-b918-49dc-8dfb-6949813ab3bc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Created reservations ['4fddebfc-d7f3-4070-b04d-3c796ecf029b', '8ca83e5f-0202-417b-a5af-dfd45f5ddd55', 'eaf4520f-d51e-47df-b372-db51c1916e78', '1c96c816-1b6d-4b5c-bec4-03a21570c10c'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d7014593-b918-49dc-8dfb-6949813ab3bc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d7014593-b918-49dc-8dfb-6949813ab3bc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d7014593-b918-49dc-8dfb-6949813ab3bc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d7014593-b918-49dc-8dfb-6949813ab3bc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d7014593-b918-49dc-8dfb-6949813ab3bc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d7014593-b918-49dc-8dfb-6949813ab3bc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:40 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:47:40 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:40 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Flow 'volume_create_manager' (384aad79-a6db-49d8-a8e9-804c4ff3059c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e8ff684-f54f-4c38-a5dd-031284d16842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e8ff684-f54f-4c38-a5dd-031284d16842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-701782135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc3dd3a6-4dbc-47af-aa9a-6452d843423f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68979c6ee0fb46259a98e7677b466805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:41Z,use_quota=True,user_id='ab1514feda4c40f9beee12ac356021ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71951b9e-90b1-4036-9306-6dfdb2e4a750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71951b9e-90b1-4036-9306-6dfdb2e4a750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a850b45c-1944-40cc-b11a-f02c2e306332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a850b45c-1944-40cc-b11a-f02c2e306332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc3dd3a6-4dbc-47af-aa9a-6452d843423f', 'volume_name': 'volume-fc3dd3a6-4dbc-47af-aa9a-6452d843423f', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a01901-2b7e-4f73-9496-3813393e7017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a01901-2b7e-4f73-9496-3813393e7017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5670c26-38a8-49a6-a79c-b0486e68c4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:40 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Volume fc3dd3a6-4dbc-47af-aa9a-6452d843423f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc3dd3a6-4dbc-47af-aa9a-6452d843423f', 'volume_size': 1} Jul 06 15:47:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:40 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-66642e65-2c7c-4bdb-a22c-42d13f725cd7 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3.63fd1490-59fc-4777-978f-0ea7fe126f58" returned: 0 in 0.829s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-66642e65-2c7c-4bdb-a22c-42d13f725cd7 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:40 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3.info Jul 06 15:47:40 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:41 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d7014593-b918-49dc-8dfb-6949813ab3bc tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.701s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:41 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-d7014593-b918-49dc-8dfb-6949813ab3bc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:41 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-d7014593-b918-49dc-8dfb-6949813ab3bc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Deleted volume successfully. Jul 06 15:47:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d7014593-b918-49dc-8dfb-6949813ab3bc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-d3a844ca-5bfa-4ee9-9838-2b9fcf86f1d8-delete_volume" released by "delete_volume" :: held 3.064s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-31fede0b-622f-40f9-84e4-09a6ee8326b0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "cinder-b85a158f-0b51-4af3-961d-5bb3427fcea2-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-31fede0b-622f-40f9-84e4-09a6ee8326b0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-b85a158f-0b51-4af3-961d-5bb3427fcea2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-31fede0b-622f-40f9-84e4-09a6ee8326b0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "cinder-quobyte-b85a158f-0b51-4af3-961d-5bb3427fcea2" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-31fede0b-622f-40f9-84e4-09a6ee8326b0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-quobyte-b85a158f-0b51-4af3-961d-5bb3427fcea2" acquired by "delete_volume" :: waited 0.020s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:41 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[05aa1f47-9466-443e-9b0c-8f7df264a845]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-31fede0b-622f-40f9-84e4-09a6ee8326b0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b85a158f-0b51-4af3-961d-5bb3427fcea2 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:41 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-66642e65-2c7c-4bdb-a22c-42d13f725cd7 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3.info" returned: 0 in 0.763s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:41 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-66642e65-2c7c-4bdb-a22c-42d13f725cd7 tempest-ProjectMemberTests-765095290 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3.info is being set with open permissions: ugo+rw Jul 06 15:47:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-66642e65-2c7c-4bdb-a22c-42d13f725cd7 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:41 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b85a158f-0b51-4af3-961d-5bb3427fcea2 Jul 06 15:47:41 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:41 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3.info Jul 06 15:47:41 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:42 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-31fede0b-622f-40f9-84e4-09a6ee8326b0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b85a158f-0b51-4af3-961d-5bb3427fcea2" returned: 0 in 0.832s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-31fede0b-622f-40f9-84e4-09a6ee8326b0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b85a158f-0b51-4af3-961d-5bb3427fcea2 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:42 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b85a158f-0b51-4af3-961d-5bb3427fcea2 Jul 06 15:47:42 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:42 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-66642e65-2c7c-4bdb-a22c-42d13f725cd7 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3.info" returned: 0 in 0.831s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-66642e65-2c7c-4bdb-a22c-42d13f725cd7 tempest-ProjectMemberTests-765095290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.514s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.774s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:42 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-701782135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc3dd3a6-4dbc-47af-aa9a-6452d843423f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68979c6ee0fb46259a98e7677b466805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:41Z,use_quota=True,user_id='ab1514feda4c40f9beee12ac356021ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:42 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Creating volume fc3dd3a6-4dbc-47af-aa9a-6452d843423f {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:42 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:42 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:42 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:42 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:47:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-fc3dd3a6-4dbc-47af-aa9a-6452d843423f 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:42 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-fc3dd3a6-4dbc-47af-aa9a-6452d843423f 1073741824 Jul 06 15:47:42 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:42 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-66642e65-2c7c-4bdb-a22c-42d13f725cd7 tempest-ProjectMemberTests-765095290 None] Create snapshot completed successfully Jul 06 15:47:42 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Flow 'volume_create_manager' (6702e087-a46a-4638-af08-82fd8ad176d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0374b62d-7ed3-4101-826b-26d6a6f63ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0374b62d-7ed3-4101-826b-26d6a6f63ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1949253150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab0decda-c706-482a-b650-9164465c751a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bead32b66fa4a30b73fb68c816ead9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:42Z,use_quota=True,user_id='88cb7bd6e9c446f78654b550786a9680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f02256d-e079-42a1-a6d7-23a011b343cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f02256d-e079-42a1-a6d7-23a011b343cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54274b83-5362-4a10-8d69-79ab254b2eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54274b83-5362-4a10-8d69-79ab254b2eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab0decda-c706-482a-b650-9164465c751a', 'volume_name': 'volume-ab0decda-c706-482a-b650-9164465c751a', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb275da-87f3-4ae7-9398-c5804ecfaa2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb275da-87f3-4ae7-9398-c5804ecfaa2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5549464d-d1cb-4ee4-b110-1ad45827de2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:42 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Volume ab0decda-c706-482a-b650-9164465c751a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab0decda-c706-482a-b650-9164465c751a', 'volume_size': 1} Jul 06 15:47:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:43 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-31fede0b-622f-40f9-84e4-09a6ee8326b0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-b85a158f-0b51-4af3-961d-5bb3427fcea2" returned: 0 in 0.730s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-31fede0b-622f-40f9-84e4-09a6ee8326b0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-quobyte-b85a158f-0b51-4af3-961d-5bb3427fcea2" released by "delete_volume" :: held 1.622s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-31fede0b-622f-40f9-84e4-09a6ee8326b0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Created reservations ['c26cd8b0-b93b-40f2-bf2b-d2929d350fba', 'cd0583c1-b093-47e4-be42-1685469fc885', '76316314-29aa-4646-8b8d-194e7dabec33', '630e02c5-94d7-4544-b90a-9fda74eddcd7'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-31fede0b-622f-40f9-84e4-09a6ee8326b0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-31fede0b-622f-40f9-84e4-09a6ee8326b0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-31fede0b-622f-40f9-84e4-09a6ee8326b0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-31fede0b-622f-40f9-84e4-09a6ee8326b0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-31fede0b-622f-40f9-84e4-09a6ee8326b0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-31fede0b-622f-40f9-84e4-09a6ee8326b0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-58bfaa67-0e14-42a7-99f5-b9e7f47ef9f7 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-63fd1490-59fc-4777-978f-0ea7fe126f58-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:43 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:47:43 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-58bfaa67-0e14-42a7-99f5-b9e7f47ef9f7 tempest-ProjectMemberTests-765095290 None] Lock "cinder-63fd1490-59fc-4777-978f-0ea7fe126f58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-58bfaa67-0e14-42a7-99f5-b9e7f47ef9f7 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-quobyte-acae495d-4f57-45a0-8d11-d883379d85d3" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-58bfaa67-0e14-42a7-99f5-b9e7f47ef9f7 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-acae495d-4f57-45a0-8d11-d883379d85d3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-58bfaa67-0e14-42a7-99f5-b9e7f47ef9f7 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-quobyte-63fd1490-59fc-4777-978f-0ea7fe126f58" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-58bfaa67-0e14-42a7-99f5-b9e7f47ef9f7 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-63fd1490-59fc-4777-978f-0ea7fe126f58" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-58bfaa67-0e14-42a7-99f5-b9e7f47ef9f7 tempest-ProjectMemberTests-765095290 None] Deleting offline snapshot 63fd1490-59fc-4777-978f-0ea7fe126f58 of volume acae495d-4f57-45a0-8d11-d883379d85d3 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-58bfaa67-0e14-42a7-99f5-b9e7f47ef9f7 tempest-ProjectMemberTests-765095290 None] snapshot_file for this snap is: volume-acae495d-4f57-45a0-8d11-d883379d85d3.63fd1490-59fc-4777-978f-0ea7fe126f58 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f429b6-3b24-47fa-ae87-857a8c173bc6]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-58bfaa67-0e14-42a7-99f5-b9e7f47ef9f7 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3.63fd1490-59fc-4777-978f-0ea7fe126f58 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:43 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-fc3dd3a6-4dbc-47af-aa9a-6452d843423f 1073741824" returned: 0 in 0.907s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-fc3dd3a6-4dbc-47af-aa9a-6452d843423f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:43 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3.63fd1490-59fc-4777-978f-0ea7fe126f58 Jul 06 15:47:43 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:43 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-fc3dd3a6-4dbc-47af-aa9a-6452d843423f Jul 06 15:47:43 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-441489cb-3d10-4dab-86f2-6dd07b7b59a2 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "cinder-0f0d683f-99e2-41b4-933f-3bed57cab4a9-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-441489cb-3d10-4dab-86f2-6dd07b7b59a2 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-0f0d683f-99e2-41b4-933f-3bed57cab4a9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-441489cb-3d10-4dab-86f2-6dd07b7b59a2 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "cinder-quobyte-0f0d683f-99e2-41b4-933f-3bed57cab4a9" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-441489cb-3d10-4dab-86f2-6dd07b7b59a2 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-quobyte-0f0d683f-99e2-41b4-933f-3bed57cab4a9" acquired by "delete_volume" :: waited 0.022s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e87ea0e-2cd4-4b21-98ad-096c6789ce68]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-441489cb-3d10-4dab-86f2-6dd07b7b59a2 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0f0d683f-99e2-41b4-933f-3bed57cab4a9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:43 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-31fede0b-622f-40f9-84e4-09a6ee8326b0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.742s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-31fede0b-622f-40f9-84e4-09a6ee8326b0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:43 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-31fede0b-622f-40f9-84e4-09a6ee8326b0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Deleted volume successfully. Jul 06 15:47:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-31fede0b-622f-40f9-84e4-09a6ee8326b0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-b85a158f-0b51-4af3-961d-5bb3427fcea2-delete_volume" released by "delete_volume" :: held 2.622s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:43 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0f0d683f-99e2-41b4-933f-3bed57cab4a9 Jul 06 15:47:43 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:44 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-fc3dd3a6-4dbc-47af-aa9a-6452d843423f" returned: 0 in 0.773s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.545s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1949253150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab0decda-c706-482a-b650-9164465c751a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bead32b66fa4a30b73fb68c816ead9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:42Z,use_quota=True,user_id='88cb7bd6e9c446f78654b550786a9680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Creating volume ab0decda-c706-482a-b650-9164465c751a {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:44 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:47:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:44 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-58bfaa67-0e14-42a7-99f5-b9e7f47ef9f7 tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3.63fd1490-59fc-4777-978f-0ea7fe126f58" returned: 0 in 0.934s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-58bfaa67-0e14-42a7-99f5-b9e7f47ef9f7 tempest-ProjectMemberTests-765095290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acae495d-4f57-45a0-8d11-d883379d85d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:47:44 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a 1073741824 Jul 06 15:47:44 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5670c26-38a8-49a6-a79c-b0486e68c4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc3dd3a6-4dbc-47af-aa9a-6452d843423f', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67df590-3643-4754-8826-3e24cf1b14f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:44 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[1100d6e5-8135-4cef-8af2-32e4534cd3be]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-58bfaa67-0e14-42a7-99f5-b9e7f47ef9f7 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:44 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Volume volume-fc3dd3a6-4dbc-47af-aa9a-6452d843423f (fc3dd3a6-4dbc-47af-aa9a-6452d843423f): created successfully Jul 06 15:47:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67df590-3643-4754-8826-3e24cf1b14f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Flow 'volume_create_manager' (384aad79-a6db-49d8-a8e9-804c4ff3059c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:44 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a02d1e28-8623-41a4-920a-310784947fd4 tempest-ProjectReaderTests-1945854864 None] Created volume successfully. Jul 06 15:47:44 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3 Jul 06 15:47:44 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:44 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-441489cb-3d10-4dab-86f2-6dd07b7b59a2 tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0f0d683f-99e2-41b4-933f-3bed57cab4a9" returned: 0 in 0.817s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-441489cb-3d10-4dab-86f2-6dd07b7b59a2 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0f0d683f-99e2-41b4-933f-3bed57cab4a9 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:44 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0f0d683f-99e2-41b4-933f-3bed57cab4a9 Jul 06 15:47:44 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:45 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-80362c61-6bd5-4687-8107-697fc526f070 tempest-ProjectReaderTests-1945854864 None] Acquiring lock "cinder-fc3dd3a6-4dbc-47af-aa9a-6452d843423f-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:45 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-80362c61-6bd5-4687-8107-697fc526f070 tempest-ProjectReaderTests-1945854864 None] Lock "cinder-fc3dd3a6-4dbc-47af-aa9a-6452d843423f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:45 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-80362c61-6bd5-4687-8107-697fc526f070 tempest-ProjectReaderTests-1945854864 None] Acquiring lock "cinder-quobyte-fc3dd3a6-4dbc-47af-aa9a-6452d843423f" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:45 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-80362c61-6bd5-4687-8107-697fc526f070 tempest-ProjectReaderTests-1945854864 None] Lock "cinder-quobyte-fc3dd3a6-4dbc-47af-aa9a-6452d843423f" acquired by "delete_volume" :: waited 0.017s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:45 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff863142-7ec1-4571-930e-650b2fcca2a6]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-80362c61-6bd5-4687-8107-697fc526f070 tempest-ProjectReaderTests-1945854864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-fc3dd3a6-4dbc-47af-aa9a-6452d843423f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:45 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a 1073741824" returned: 0 in 1.011s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:45 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-fc3dd3a6-4dbc-47af-aa9a-6452d843423f Jul 06 15:47:45 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:45 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-58bfaa67-0e14-42a7-99f5-b9e7f47ef9f7 tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3" returned: 0 in 1.007s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-58bfaa67-0e14-42a7-99f5-b9e7f47ef9f7 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3.63fd1490-59fc-4777-978f-0ea7fe126f58 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:45 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a Jul 06 15:47:45 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:45 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3.63fd1490-59fc-4777-978f-0ea7fe126f58 Jul 06 15:47:45 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:45 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-441489cb-3d10-4dab-86f2-6dd07b7b59a2 tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-0f0d683f-99e2-41b4-933f-3bed57cab4a9" returned: 0 in 0.761s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:45 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-441489cb-3d10-4dab-86f2-6dd07b7b59a2 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-quobyte-0f0d683f-99e2-41b4-933f-3bed57cab4a9" released by "delete_volume" :: held 1.629s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:45 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-441489cb-3d10-4dab-86f2-6dd07b7b59a2 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Created reservations ['7c13fdd2-3007-4114-b580-ecb375988008', 'cb96fe4b-9728-4665-b789-4cb1b27c2435', '44e1f766-8ceb-4b56-82ab-c14017fc06b1', '6c35bd25-86c7-4a77-b8f1-92e9abffd429'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-441489cb-3d10-4dab-86f2-6dd07b7b59a2 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-441489cb-3d10-4dab-86f2-6dd07b7b59a2 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-441489cb-3d10-4dab-86f2-6dd07b7b59a2 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-441489cb-3d10-4dab-86f2-6dd07b7b59a2 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-441489cb-3d10-4dab-86f2-6dd07b7b59a2 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-441489cb-3d10-4dab-86f2-6dd07b7b59a2 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:45 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:47:45 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8a739b2f-9c01-4594-b289-559c5f6e40f0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "cinder-14f4173f-0dbe-4eb6-8a80-01038cef4503-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8a739b2f-9c01-4594-b289-559c5f6e40f0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-14f4173f-0dbe-4eb6-8a80-01038cef4503-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:46 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-80362c61-6bd5-4687-8107-697fc526f070 tempest-ProjectReaderTests-1945854864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-fc3dd3a6-4dbc-47af-aa9a-6452d843423f" returned: 0 in 0.957s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-80362c61-6bd5-4687-8107-697fc526f070 tempest-ProjectReaderTests-1945854864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-fc3dd3a6-4dbc-47af-aa9a-6452d843423f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:46 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-fc3dd3a6-4dbc-47af-aa9a-6452d843423f Jul 06 15:47:46 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8a739b2f-9c01-4594-b289-559c5f6e40f0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "cinder-quobyte-14f4173f-0dbe-4eb6-8a80-01038cef4503" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8a739b2f-9c01-4594-b289-559c5f6e40f0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-quobyte-14f4173f-0dbe-4eb6-8a80-01038cef4503" acquired by "delete_volume" :: waited 0.037s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:46 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[da33fc73-4b86-4d67-b571-4cc86b240dfc]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8a739b2f-9c01-4594-b289-559c5f6e40f0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-14f4173f-0dbe-4eb6-8a80-01038cef4503 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:46 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a" returned: 0 in 1.128s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] <== create_volume: return (2194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.200s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5549464d-d1cb-4ee4-b110-1ad45827de2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab0decda-c706-482a-b650-9164465c751a', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9d4fe4-e6e9-4f48-bc67-f99dbe83252c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:46 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-441489cb-3d10-4dab-86f2-6dd07b7b59a2 tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.891s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:46 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-441489cb-3d10-4dab-86f2-6dd07b7b59a2 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:46 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-14f4173f-0dbe-4eb6-8a80-01038cef4503 Jul 06 15:47:46 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:46 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Volume volume-ab0decda-c706-482a-b650-9164465c751a (ab0decda-c706-482a-b650-9164465c751a): created successfully Jul 06 15:47:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9d4fe4-e6e9-4f48-bc67-f99dbe83252c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Flow 'volume_create_manager' (6702e087-a46a-4638-af08-82fd8ad176d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:46 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-441489cb-3d10-4dab-86f2-6dd07b7b59a2 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Deleted volume successfully. Jul 06 15:47:46 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-12333e64-3a4b-47e0-a886-3622eb677c80 tempest-VolumeDependencyTests-877105953 None] Created volume successfully. Jul 06 15:47:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-441489cb-3d10-4dab-86f2-6dd07b7b59a2 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-0f0d683f-99e2-41b4-933f-3bed57cab4a9-delete_volume" released by "delete_volume" :: held 2.801s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:46 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-58bfaa67-0e14-42a7-99f5-b9e7f47ef9f7 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3.63fd1490-59fc-4777-978f-0ea7fe126f58" returned: 0 in 1.295s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-58bfaa67-0e14-42a7-99f5-b9e7f47ef9f7 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3.63fd1490-59fc-4777-978f-0ea7fe126f58 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:46 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3.63fd1490-59fc-4777-978f-0ea7fe126f58 Jul 06 15:47:46 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:46 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-80362c61-6bd5-4687-8107-697fc526f070 tempest-ProjectReaderTests-1945854864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-fc3dd3a6-4dbc-47af-aa9a-6452d843423f" returned: 0 in 0.779s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-80362c61-6bd5-4687-8107-697fc526f070 tempest-ProjectReaderTests-1945854864 None] Lock "cinder-quobyte-fc3dd3a6-4dbc-47af-aa9a-6452d843423f" released by "delete_volume" :: held 1.790s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:47 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-80362c61-6bd5-4687-8107-697fc526f070 tempest-ProjectReaderTests-1945854864 None] Created reservations ['8a7ee221-e2d5-419d-a5fa-fa72768b4f6d', 'c6259b5b-a833-4211-8d92-3fec318708da', '22e2a432-074f-4948-b96c-a1daa87e1254', 'eccd56fd-c869-419d-9776-415a2ae6e5fd'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-07b16700-f8a2-42d4-a1e0-1c927a4b6bec tempest-VolumeDependencyTests-877105953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-07b16700-f8a2-42d4-a1e0-1c927a4b6bec tempest-VolumeDependencyTests-877105953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:47 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-07b16700-f8a2-42d4-a1e0-1c927a4b6bec tempest-VolumeDependencyTests-877105953 None] Creating offline snapshot 7c6f546b-b562-49fb-9295-c3fc8ab44ff1 of volume ab0decda-c706-482a-b650-9164465c751a {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:47:47 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29f5f2b-d8b4-42cf-b259-ff4294a4cc38]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-07b16700-f8a2-42d4-a1e0-1c927a4b6bec tempest-VolumeDependencyTests-877105953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-80362c61-6bd5-4687-8107-697fc526f070 tempest-ProjectReaderTests-1945854864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-80362c61-6bd5-4687-8107-697fc526f070 tempest-ProjectReaderTests-1945854864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:47 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-80362c61-6bd5-4687-8107-697fc526f070 tempest-ProjectReaderTests-1945854864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:47 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-80362c61-6bd5-4687-8107-697fc526f070 tempest-ProjectReaderTests-1945854864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-80362c61-6bd5-4687-8107-697fc526f070 tempest-ProjectReaderTests-1945854864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-80362c61-6bd5-4687-8107-697fc526f070 tempest-ProjectReaderTests-1945854864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:47 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:47:47 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:47 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:47 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a Jul 06 15:47:47 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8a739b2f-9c01-4594-b289-559c5f6e40f0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-14f4173f-0dbe-4eb6-8a80-01038cef4503" returned: 0 in 1.032s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8a739b2f-9c01-4594-b289-559c5f6e40f0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-14f4173f-0dbe-4eb6-8a80-01038cef4503 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:47 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-14f4173f-0dbe-4eb6-8a80-01038cef4503 Jul 06 15:47:47 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:47 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-58bfaa67-0e14-42a7-99f5-b9e7f47ef9f7 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3.63fd1490-59fc-4777-978f-0ea7fe126f58" returned: 0 in 0.834s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:47 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-58bfaa67-0e14-42a7-99f5-b9e7f47ef9f7 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-63fd1490-59fc-4777-978f-0ea7fe126f58" released by "_delete_snapshot" :: held 4.294s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:47 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-58bfaa67-0e14-42a7-99f5-b9e7f47ef9f7 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-acae495d-4f57-45a0-8d11-d883379d85d3" released by "delete_snapshot" :: held 4.331s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:47 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-58bfaa67-0e14-42a7-99f5-b9e7f47ef9f7 tempest-ProjectMemberTests-765095290 None] Created reservations ['93a070fa-80bf-4326-a953-2d7403cb2e6c', '43bbcd0b-8cf4-4d98-8686-a886c08b8bdd', 'c646f952-315a-4bdf-adab-438daf289d96', 'c0e66976-608e-4aa6-b79c-d2a3f0743b73'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:47 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-58bfaa67-0e14-42a7-99f5-b9e7f47ef9f7 tempest-ProjectMemberTests-765095290 None] Delete snapshot completed successfully. Jul 06 15:47:47 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-58bfaa67-0e14-42a7-99f5-b9e7f47ef9f7 tempest-ProjectMemberTests-765095290 None] Lock "cinder-63fd1490-59fc-4777-978f-0ea7fe126f58-delete_snapshot" released by "delete_snapshot" :: held 4.622s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Flow 'volume_create_manager' (413df4c4-d6c5-427a-9117-dad26d0a962e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e9d15b-9cfd-4fc7-bb30-90780cc2647d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e9d15b-9cfd-4fc7-bb30-90780cc2647d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1486303965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=612ed91a-800a-4aa8-b215-815bd9e525f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68979c6ee0fb46259a98e7677b466805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:48Z,use_quota=True,user_id='ab1514feda4c40f9beee12ac356021ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a9f8e20-92ed-456e-b172-bbfc6cfb6301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a9f8e20-92ed-456e-b172-bbfc6cfb6301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0cfcca-48f6-4f1a-ab83-934cb8f386e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0cfcca-48f6-4f1a-ab83-934cb8f386e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '612ed91a-800a-4aa8-b215-815bd9e525f5', 'volume_name': 'volume-612ed91a-800a-4aa8-b215-815bd9e525f5', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (399ac8c6-4a08-44e2-850e-ca56dc8bdb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (399ac8c6-4a08-44e2-850e-ca56dc8bdb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c12f6d-b9a4-428a-9761-d33e6c4d2b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:48 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Volume 612ed91a-800a-4aa8-b215-815bd9e525f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-612ed91a-800a-4aa8-b215-815bd9e525f5', 'volume_size': 1} Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:48 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-07b16700-f8a2-42d4-a1e0-1c927a4b6bec tempest-VolumeDependencyTests-877105953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a" returned: 0 in 0.981s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-07b16700-f8a2-42d4-a1e0-1c927a4b6bec tempest-VolumeDependencyTests-877105953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.7c6f546b-b562-49fb-9295-c3fc8ab44ff1 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:48 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.7c6f546b-b562-49fb-9295-c3fc8ab44ff1 1G Jul 06 15:47:48 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:48 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-80362c61-6bd5-4687-8107-697fc526f070 tempest-ProjectReaderTests-1945854864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.996s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-80362c61-6bd5-4687-8107-697fc526f070 tempest-ProjectReaderTests-1945854864 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:48 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-80362c61-6bd5-4687-8107-697fc526f070 tempest-ProjectReaderTests-1945854864 None] Deleted volume successfully. Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-80362c61-6bd5-4687-8107-697fc526f070 tempest-ProjectReaderTests-1945854864 None] Lock "cinder-fc3dd3a6-4dbc-47af-aa9a-6452d843423f-delete_volume" released by "delete_volume" :: held 3.147s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:48 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8a739b2f-9c01-4594-b289-559c5f6e40f0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-14f4173f-0dbe-4eb6-8a80-01038cef4503" returned: 0 in 0.990s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8a739b2f-9c01-4594-b289-559c5f6e40f0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-quobyte-14f4173f-0dbe-4eb6-8a80-01038cef4503" released by "delete_volume" :: held 2.085s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-8a739b2f-9c01-4594-b289-559c5f6e40f0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Created reservations ['4a8bf068-bd1b-4297-94f1-a76d750d1ab5', '2d1a7b29-b695-4136-9b67-9114d0271db5', 'e3efa711-9ab1-4174-97aa-945e8c10f6cf', 'c7e7709c-10c2-4c8e-b819-3563e0289939'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8a739b2f-9c01-4594-b289-559c5f6e40f0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8a739b2f-9c01-4594-b289-559c5f6e40f0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-8a739b2f-9c01-4594-b289-559c5f6e40f0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-8a739b2f-9c01-4594-b289-559c5f6e40f0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8a739b2f-9c01-4594-b289-559c5f6e40f0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8a739b2f-9c01-4594-b289-559c5f6e40f0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:48 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:47:48 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ab22f034-b047-41c2-af80-c6ad23e9e2ab tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-acae495d-4f57-45a0-8d11-d883379d85d3-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ab22f034-b047-41c2-af80-c6ad23e9e2ab tempest-ProjectMemberTests-765095290 None] Lock "cinder-acae495d-4f57-45a0-8d11-d883379d85d3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ab22f034-b047-41c2-af80-c6ad23e9e2ab tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-quobyte-acae495d-4f57-45a0-8d11-d883379d85d3" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ab22f034-b047-41c2-af80-c6ad23e9e2ab tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-acae495d-4f57-45a0-8d11-d883379d85d3" acquired by "delete_volume" :: waited 0.030s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1a036f-91c3-4f98-9f36-f76bcc3b28a1]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ab22f034-b047-41c2-af80-c6ad23e9e2ab tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:48 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3 Jul 06 15:47:48 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:49 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-07b16700-f8a2-42d4-a1e0-1c927a4b6bec tempest-VolumeDependencyTests-877105953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.7c6f546b-b562-49fb-9295-c3fc8ab44ff1 1G" returned: 0 in 0.894s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-07b16700-f8a2-42d4-a1e0-1c927a4b6bec tempest-VolumeDependencyTests-877105953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab0decda-c706-482a-b650-9164465c751a -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.7c6f546b-b562-49fb-9295-c3fc8ab44ff1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:49 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab0decda-c706-482a-b650-9164465c751a -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.7c6f546b-b562-49fb-9295-c3fc8ab44ff1 Jul 06 15:47:49 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:49 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8a739b2f-9c01-4594-b289-559c5f6e40f0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.841s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:49 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-8a739b2f-9c01-4594-b289-559c5f6e40f0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:49 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-8a739b2f-9c01-4594-b289-559c5f6e40f0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Deleted volume successfully. Jul 06 15:47:49 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8a739b2f-9c01-4594-b289-559c5f6e40f0 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-14f4173f-0dbe-4eb6-8a80-01038cef4503-delete_volume" released by "delete_volume" :: held 3.238s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:49 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-587ae789-fb93-4ab4-a596-8c203ad47379 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "cinder-7b9e49c5-e004-4fcb-a7ae-060eb61271f3-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:49 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-587ae789-fb93-4ab4-a596-8c203ad47379 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-7b9e49c5-e004-4fcb-a7ae-060eb61271f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:49 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-587ae789-fb93-4ab4-a596-8c203ad47379 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "cinder-quobyte-428f7bb9-ef82-43b4-af7d-9c67322c4da1" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:49 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-587ae789-fb93-4ab4-a596-8c203ad47379 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-quobyte-428f7bb9-ef82-43b4-af7d-9c67322c4da1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:49 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-587ae789-fb93-4ab4-a596-8c203ad47379 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "cinder-quobyte-7b9e49c5-e004-4fcb-a7ae-060eb61271f3" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:49 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-587ae789-fb93-4ab4-a596-8c203ad47379 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-quobyte-7b9e49c5-e004-4fcb-a7ae-060eb61271f3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-587ae789-fb93-4ab4-a596-8c203ad47379 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Deleting offline snapshot 7b9e49c5-e004-4fcb-a7ae-060eb61271f3 of volume 428f7bb9-ef82-43b4-af7d-9c67322c4da1 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:47:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-587ae789-fb93-4ab4-a596-8c203ad47379 tempest-CreateVolumesFromSnapshotTest-1262682818 None] snapshot_file for this snap is: volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1.7b9e49c5-e004-4fcb-a7ae-060eb61271f3 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:47:49 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ea555a-85a1-492b-af2a-6a0cf150541a]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-587ae789-fb93-4ab4-a596-8c203ad47379 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1.7b9e49c5-e004-4fcb-a7ae-060eb61271f3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:49 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ab22f034-b047-41c2-af80-c6ad23e9e2ab tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3" returned: 0 in 0.836s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ab22f034-b047-41c2-af80-c6ad23e9e2ab tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:49 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3 Jul 06 15:47:49 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:49 devstack sudo[105043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1.7b9e49c5-e004-4fcb-a7ae-060eb61271f3 Jul 06 15:47:49 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:49 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-07b16700-f8a2-42d4-a1e0-1c927a4b6bec tempest-VolumeDependencyTests-877105953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab0decda-c706-482a-b650-9164465c751a -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.7c6f546b-b562-49fb-9295-c3fc8ab44ff1" returned: 0 in 0.835s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:49 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-07b16700-f8a2-42d4-a1e0-1c927a4b6bec tempest-VolumeDependencyTests-877105953 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.7c6f546b-b562-49fb-9295-c3fc8ab44ff1 is being set with open permissions: ugo+rw Jul 06 15:47:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-07b16700-f8a2-42d4-a1e0-1c927a4b6bec tempest-VolumeDependencyTests-877105953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.7c6f546b-b562-49fb-9295-c3fc8ab44ff1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:49 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.7c6f546b-b562-49fb-9295-c3fc8ab44ff1 Jul 06 15:47:49 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:50 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ab22f034-b047-41c2-af80-c6ad23e9e2ab tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-acae495d-4f57-45a0-8d11-d883379d85d3" returned: 0 in 0.698s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:50 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ab22f034-b047-41c2-af80-c6ad23e9e2ab tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-acae495d-4f57-45a0-8d11-d883379d85d3" released by "delete_volume" :: held 1.607s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:50 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-ab22f034-b047-41c2-af80-c6ad23e9e2ab tempest-ProjectMemberTests-765095290 None] Created reservations ['042b5dfc-7c4b-460b-b606-d7e3db536bdd', '36f0f41c-68c5-462b-9290-08257a9228a8', 'ee14e300-0c5b-481b-97ef-8c2bf03833ff', '60b70cfa-65c4-43e1-86cd-c55c95c6cd70'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:50 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-587ae789-fb93-4ab4-a596-8c203ad47379 tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1.7b9e49c5-e004-4fcb-a7ae-060eb61271f3" returned: 0 in 0.897s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:50 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-587ae789-fb93-4ab4-a596-8c203ad47379 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:47:50 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[897018c6-2d20-4de3-9f2f-3eff56f486a7]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-587ae789-fb93-4ab4-a596-8c203ad47379 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ab22f034-b047-41c2-af80-c6ad23e9e2ab tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ab22f034-b047-41c2-af80-c6ad23e9e2ab tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:50 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ab22f034-b047-41c2-af80-c6ad23e9e2ab tempest-ProjectMemberTests-765095290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:50 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ab22f034-b047-41c2-af80-c6ad23e9e2ab tempest-ProjectMemberTests-765095290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ab22f034-b047-41c2-af80-c6ad23e9e2ab tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ab22f034-b047-41c2-af80-c6ad23e9e2ab tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:50 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-07b16700-f8a2-42d4-a1e0-1c927a4b6bec tempest-VolumeDependencyTests-877105953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.7c6f546b-b562-49fb-9295-c3fc8ab44ff1" returned: 0 in 0.672s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:50 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:47:50 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-07b16700-f8a2-42d4-a1e0-1c927a4b6bec tempest-VolumeDependencyTests-877105953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:50 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.info Jul 06 15:47:50 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:50 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1 Jul 06 15:47:50 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:51 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-07b16700-f8a2-42d4-a1e0-1c927a4b6bec tempest-VolumeDependencyTests-877105953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.info" returned: 0 in 0.740s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:51 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-07b16700-f8a2-42d4-a1e0-1c927a4b6bec tempest-VolumeDependencyTests-877105953 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.info is being set with open permissions: ugo+rw Jul 06 15:47:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-07b16700-f8a2-42d4-a1e0-1c927a4b6bec tempest-VolumeDependencyTests-877105953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:51 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.info Jul 06 15:47:51 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:51 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ab22f034-b047-41c2-af80-c6ad23e9e2ab tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.887s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:51 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-ab22f034-b047-41c2-af80-c6ad23e9e2ab tempest-ProjectMemberTests-765095290 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:51 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-ab22f034-b047-41c2-af80-c6ad23e9e2ab tempest-ProjectMemberTests-765095290 None] Deleted volume successfully. Jul 06 15:47:51 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Flow 'volume_create_manager' (f6d55e88-54ef-434d-b56a-15d26365003c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c35ed80-d95c-4ada-96e8-093606f64dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c35ed80-d95c-4ada-96e8-093606f64dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-507657886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a78d77e1-a53f-418b-85d7-b24664a68064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2acfd7a95ae04e6a8c97cbd4d6771d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:51Z,use_quota=True,user_id='c8e50c716ff74461bb8f1c33607ef860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b9d993-cf06-4db1-ab24-d52c669c51d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b9d993-cf06-4db1-ab24-d52c669c51d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22103ffb-03c1-44aa-8138-de8d42379389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:51 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22103ffb-03c1-44aa-8138-de8d42379389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a78d77e1-a53f-418b-85d7-b24664a68064', 'volume_name': 'volume-a78d77e1-a53f-418b-85d7-b24664a68064', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e3aed71-8b5f-460d-a60e-29c9103802d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e3aed71-8b5f-460d-a60e-29c9103802d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:51 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286af5be-ab80-4a06-a0d7-1277bcb0f3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:51 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Volume a78d77e1-a53f-418b-85d7-b24664a68064: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a78d77e1-a53f-418b-85d7-b24664a68064', 'volume_size': 1} Jul 06 15:47:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:51 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ab22f034-b047-41c2-af80-c6ad23e9e2ab tempest-ProjectMemberTests-765095290 None] Lock "cinder-acae495d-4f57-45a0-8d11-d883379d85d3-delete_volume" released by "delete_volume" :: held 2.891s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-587ae789-fb93-4ab4-a596-8c203ad47379 tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1" returned: 0 in 1.038s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-587ae789-fb93-4ab4-a596-8c203ad47379 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1.7b9e49c5-e004-4fcb-a7ae-060eb61271f3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:51 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1.7b9e49c5-e004-4fcb-a7ae-060eb61271f3 Jul 06 15:47:51 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:52 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-07b16700-f8a2-42d4-a1e0-1c927a4b6bec tempest-VolumeDependencyTests-877105953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.info" returned: 0 in 0.667s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-07b16700-f8a2-42d4-a1e0-1c927a4b6bec tempest-VolumeDependencyTests-877105953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.884s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.872s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:52 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1486303965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=612ed91a-800a-4aa8-b215-815bd9e525f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68979c6ee0fb46259a98e7677b466805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:48Z,use_quota=True,user_id='ab1514feda4c40f9beee12ac356021ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:52 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Creating volume 612ed91a-800a-4aa8-b215-815bd9e525f5 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:52 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:52 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:52 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:52 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:47:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-612ed91a-800a-4aa8-b215-815bd9e525f5 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:52 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-612ed91a-800a-4aa8-b215-815bd9e525f5 1073741824 Jul 06 15:47:52 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:52 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-07b16700-f8a2-42d4-a1e0-1c927a4b6bec tempest-VolumeDependencyTests-877105953 None] Create snapshot completed successfully Jul 06 15:47:52 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-587ae789-fb93-4ab4-a596-8c203ad47379 tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1.7b9e49c5-e004-4fcb-a7ae-060eb61271f3" returned: 0 in 0.832s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-587ae789-fb93-4ab4-a596-8c203ad47379 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1.7b9e49c5-e004-4fcb-a7ae-060eb61271f3 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:52 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1.7b9e49c5-e004-4fcb-a7ae-060eb61271f3 Jul 06 15:47:52 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:52 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:53 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Flow 'volume_create_manager' (57e36b71-9785-4330-b0e0-2b275b06dc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eab2806-9ba4-4e36-9868-499856a5af33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-612ed91a-800a-4aa8-b215-815bd9e525f5 1073741824" returned: 0 in 0.986s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:53 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eab2806-9ba4-4e36-9868-499856a5af33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-315003244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb54270e-7858-4e94-b1f5-218bbdf967df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bead32b66fa4a30b73fb68c816ead9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7c6f546b-b562-49fb-9295-c3fc8ab44ff1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:53Z,use_quota=True,user_id='88cb7bd6e9c446f78654b550786a9680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b7e7538-f191-46b6-a525-5928008beeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b7e7538-f191-46b6-a525-5928008beeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d611c88e-b4c2-4925-8a67-9578c5d6935a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d611c88e-b4c2-4925-8a67-9578c5d6935a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cb54270e-7858-4e94-b1f5-218bbdf967df', 'volume_name': 'volume-cb54270e-7858-4e94-b1f5-218bbdf967df', 'volume_size': 1, 'snapshot_id': '7c6f546b-b562-49fb-9295-c3fc8ab44ff1'}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639f43d0-7c86-48d6-bfa6-48b09d978187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639f43d0-7c86-48d6-bfa6-48b09d978187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e0f3cc-dcf0-4418-af53-5f85456c6200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:53 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Volume cb54270e-7858-4e94-b1f5-218bbdf967df: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cb54270e-7858-4e94-b1f5-218bbdf967df', 'volume_size': 1, 'snapshot_id': '7c6f546b-b562-49fb-9295-c3fc8ab44ff1'} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-587ae789-fb93-4ab4-a596-8c203ad47379 tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1.7b9e49c5-e004-4fcb-a7ae-060eb61271f3" returned: 0 in 0.709s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-612ed91a-800a-4aa8-b215-815bd9e525f5 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-587ae789-fb93-4ab4-a596-8c203ad47379 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-quobyte-7b9e49c5-e004-4fcb-a7ae-060eb61271f3" released by "_delete_snapshot" :: held 3.618s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-587ae789-fb93-4ab4-a596-8c203ad47379 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-quobyte-428f7bb9-ef82-43b4-af7d-9c67322c4da1" released by "delete_snapshot" :: held 3.644s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:53 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-612ed91a-800a-4aa8-b215-815bd9e525f5 Jul 06 15:47:53 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-587ae789-fb93-4ab4-a596-8c203ad47379 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Created reservations ['9f5f0f80-5562-464d-b324-c4e5bdc0dd3b', '02fe3002-67bb-42a2-ab84-dae992a83e11', '905d2003-3e83-4672-93b8-6cd80db0a988', 'fe0b8d55-8992-4f27-873c-f1604bdebb5d'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:53 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-587ae789-fb93-4ab4-a596-8c203ad47379 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Delete snapshot completed successfully. Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-587ae789-fb93-4ab4-a596-8c203ad47379 tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-7b9e49c5-e004-4fcb-a7ae-060eb61271f3-delete_snapshot" released by "delete_snapshot" :: held 3.781s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-451447c1-123f-4e6b-93a6-9bb41dd69cfc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "cinder-428f7bb9-ef82-43b4-af7d-9c67322c4da1-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-451447c1-123f-4e6b-93a6-9bb41dd69cfc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-428f7bb9-ef82-43b4-af7d-9c67322c4da1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:53 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-612ed91a-800a-4aa8-b215-815bd9e525f5" returned: 0 in 0.670s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.264s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-507657886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a78d77e1-a53f-418b-85d7-b24664a68064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2acfd7a95ae04e6a8c97cbd4d6771d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:51Z,use_quota=True,user_id='c8e50c716ff74461bb8f1c33607ef860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Creating volume a78d77e1-a53f-418b-85d7-b24664a68064 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:53 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:53 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064 1073741824 Jul 06 15:47:53 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-451447c1-123f-4e6b-93a6-9bb41dd69cfc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "cinder-quobyte-428f7bb9-ef82-43b4-af7d-9c67322c4da1" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c12f6d-b9a4-428a-9761-d33e6c4d2b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-612ed91a-800a-4aa8-b215-815bd9e525f5', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b9f3cc-e79a-4f26-82d5-2647198a82fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-451447c1-123f-4e6b-93a6-9bb41dd69cfc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-quobyte-428f7bb9-ef82-43b4-af7d-9c67322c4da1" acquired by "delete_volume" :: waited 0.043s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:53 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Volume volume-612ed91a-800a-4aa8-b215-815bd9e525f5 (612ed91a-800a-4aa8-b215-815bd9e525f5): created successfully Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b9f3cc-e79a-4f26-82d5-2647198a82fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Flow 'volume_create_manager' (413df4c4-d6c5-427a-9117-dad26d0a962e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b771c4-c83d-4a41-98a5-213710b2bc62]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-451447c1-123f-4e6b-93a6-9bb41dd69cfc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:53 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-0bb84e61-af20-48e6-8dd4-73d8e29f7fb4 tempest-ProjectReaderTests-1945854864 None] Created volume successfully. Jul 06 15:47:54 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1 Jul 06 15:47:54 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1216e3fa-7129-4706-b258-19cf86d0f8e0 tempest-ProjectReaderTests-1945854864 None] Acquiring lock "cinder-612ed91a-800a-4aa8-b215-815bd9e525f5-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1216e3fa-7129-4706-b258-19cf86d0f8e0 tempest-ProjectReaderTests-1945854864 None] Lock "cinder-612ed91a-800a-4aa8-b215-815bd9e525f5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1216e3fa-7129-4706-b258-19cf86d0f8e0 tempest-ProjectReaderTests-1945854864 None] Acquiring lock "cinder-quobyte-612ed91a-800a-4aa8-b215-815bd9e525f5" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1216e3fa-7129-4706-b258-19cf86d0f8e0 tempest-ProjectReaderTests-1945854864 None] Lock "cinder-quobyte-612ed91a-800a-4aa8-b215-815bd9e525f5" acquired by "delete_volume" :: waited 0.023s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:54 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e7f6dc-9ae8-4e7e-9c1d-b8d214b33b86]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1216e3fa-7129-4706-b258-19cf86d0f8e0 tempest-ProjectReaderTests-1945854864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-612ed91a-800a-4aa8-b215-815bd9e525f5 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:54 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064 1073741824" returned: 0 in 0.898s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:54 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-612ed91a-800a-4aa8-b215-815bd9e525f5 Jul 06 15:47:54 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:54 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-451447c1-123f-4e6b-93a6-9bb41dd69cfc tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1" returned: 0 in 0.839s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-451447c1-123f-4e6b-93a6-9bb41dd69cfc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:54 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1 Jul 06 15:47:54 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:54 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064 Jul 06 15:47:54 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:55 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1216e3fa-7129-4706-b258-19cf86d0f8e0 tempest-ProjectReaderTests-1945854864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-612ed91a-800a-4aa8-b215-815bd9e525f5" returned: 0 in 0.784s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1216e3fa-7129-4706-b258-19cf86d0f8e0 tempest-ProjectReaderTests-1945854864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-612ed91a-800a-4aa8-b215-815bd9e525f5 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:55 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-612ed91a-800a-4aa8-b215-815bd9e525f5 Jul 06 15:47:55 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:55 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-451447c1-123f-4e6b-93a6-9bb41dd69cfc tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-428f7bb9-ef82-43b4-af7d-9c67322c4da1" returned: 0 in 0.678s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:55 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064" returned: 0 in 0.678s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-451447c1-123f-4e6b-93a6-9bb41dd69cfc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-quobyte-428f7bb9-ef82-43b4-af7d-9c67322c4da1" released by "delete_volume" :: held 1.593s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.382s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Acquiring lock "cinder-quobyte-7c6f546b-b562-49fb-9295-c3fc8ab44ff1-cb54270e-7858-4e94-b1f5-218bbdf967df" by "_create_volume_from_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286af5be-ab80-4a06-a0d7-1277bcb0f3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a78d77e1-a53f-418b-85d7-b24664a68064', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ab9bd0-5d04-4531-a212-29bcdef436cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:55 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Volume volume-a78d77e1-a53f-418b-85d7-b24664a68064 (a78d77e1-a53f-418b-85d7-b24664a68064): created successfully Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ab9bd0-5d04-4531-a212-29bcdef436cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Flow 'volume_create_manager' (f6d55e88-54ef-434d-b56a-15d26365003c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Lock "cinder-quobyte-7c6f546b-b562-49fb-9295-c3fc8ab44ff1-cb54270e-7858-4e94-b1f5-218bbdf967df" acquired by "_create_volume_from_snapshot" :: waited 0.062s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Creating volume cb54270e-7858-4e94-b1f5-218bbdf967df from snapshot 7c6f546b-b562-49fb-9295-c3fc8ab44ff1 {{(pid=86148) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Acquiring lock "cinder-quobyte-cb54270e-7858-4e94-b1f5-218bbdf967df" by "_copy_volume_from_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:55 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-f24c308b-e3fd-4799-8853-6f756c982621 tempest-ProjectMemberTests-765095290 None] Created volume successfully. Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Lock "cinder-quobyte-cb54270e-7858-4e94-b1f5-218bbdf967df" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] snapshot: 7c6f546b-b562-49fb-9295-c3fc8ab44ff1, volume: cb54270e-7858-4e94-b1f5-218bbdf967df, {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-451447c1-123f-4e6b-93a6-9bb41dd69cfc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Created reservations ['e7df6738-85d1-464e-a526-c3db74ae98e0', '166a4cc6-5adb-4df6-b07c-257424de0ab2', '0dcb692e-cb5c-43aa-8e69-2097ca0f1aca', '04b25bef-3550-497a-b8d0-ec26da44a40f'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d81b55-23d4-4505-b3af-48ff623fa1a5]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.7c6f546b-b562-49fb-9295-c3fc8ab44ff1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-451447c1-123f-4e6b-93a6-9bb41dd69cfc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-451447c1-123f-4e6b-93a6-9bb41dd69cfc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-451447c1-123f-4e6b-93a6-9bb41dd69cfc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-451447c1-123f-4e6b-93a6-9bb41dd69cfc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-451447c1-123f-4e6b-93a6-9bb41dd69cfc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-451447c1-123f-4e6b-93a6-9bb41dd69cfc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:55 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:47:55 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:55 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.7c6f546b-b562-49fb-9295-c3fc8ab44ff1 Jul 06 15:47:55 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:56 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1216e3fa-7129-4706-b258-19cf86d0f8e0 tempest-ProjectReaderTests-1945854864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-612ed91a-800a-4aa8-b215-815bd9e525f5" returned: 0 in 0.690s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1216e3fa-7129-4706-b258-19cf86d0f8e0 tempest-ProjectReaderTests-1945854864 None] Lock "cinder-quobyte-612ed91a-800a-4aa8-b215-815bd9e525f5" released by "delete_volume" :: held 1.537s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:56 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-1216e3fa-7129-4706-b258-19cf86d0f8e0 tempest-ProjectReaderTests-1945854864 None] Created reservations ['19e19380-1ab6-4fd0-bc27-186173e70a44', 'c8558a80-963c-4d4e-97ac-cb84cb5eaaa5', '91b4f8ed-040d-4c4e-866a-e222aa864ad7', 'f7e069d2-1727-4cab-80d6-db2b82b84aeb'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1216e3fa-7129-4706-b258-19cf86d0f8e0 tempest-ProjectReaderTests-1945854864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1216e3fa-7129-4706-b258-19cf86d0f8e0 tempest-ProjectReaderTests-1945854864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1216e3fa-7129-4706-b258-19cf86d0f8e0 tempest-ProjectReaderTests-1945854864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1216e3fa-7129-4706-b258-19cf86d0f8e0 tempest-ProjectReaderTests-1945854864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1216e3fa-7129-4706-b258-19cf86d0f8e0 tempest-ProjectReaderTests-1945854864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1216e3fa-7129-4706-b258-19cf86d0f8e0 tempest-ProjectReaderTests-1945854864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:56 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:47:56 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:56 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-451447c1-123f-4e6b-93a6-9bb41dd69cfc tempest-CreateVolumesFromSnapshotTest-1262682818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.680s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:56 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-451447c1-123f-4e6b-93a6-9bb41dd69cfc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:56 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-451447c1-123f-4e6b-93a6-9bb41dd69cfc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Deleted volume successfully. Jul 06 15:47:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-451447c1-123f-4e6b-93a6-9bb41dd69cfc tempest-CreateVolumesFromSnapshotTest-1262682818 None] Lock "cinder-428f7bb9-ef82-43b4-af7d-9c67322c4da1-delete_volume" released by "delete_volume" :: held 2.697s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:56 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.7c6f546b-b562-49fb-9295-c3fc8ab44ff1" returned: 0 in 0.925s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab0decda-c706-482a-b650-9164465c751a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:47:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 15:47:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Creating direct copy from snapshot {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 15:47:56 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc0bdd3-f572-4077-a179-0fa0fa64b8ba]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:56 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a Jul 06 15:47:56 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-82dbab15-c180-4f46-a3d5-4d7892065c7e tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:57 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1216e3fa-7129-4706-b258-19cf86d0f8e0 tempest-ProjectReaderTests-1945854864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.881s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:57 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-1216e3fa-7129-4706-b258-19cf86d0f8e0 tempest-ProjectReaderTests-1945854864 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:57 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-1216e3fa-7129-4706-b258-19cf86d0f8e0 tempest-ProjectReaderTests-1945854864 None] Deleted volume successfully. Jul 06 15:47:57 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1216e3fa-7129-4706-b258-19cf86d0f8e0 tempest-ProjectReaderTests-1945854864 None] Lock "cinder-612ed91a-800a-4aa8-b215-815bd9e525f5-delete_volume" released by "delete_volume" :: held 2.672s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:57 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a" returned: 0 in 1.067s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:57 devstack cinder-volume[86148]: DEBUG cinder.utils [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Path /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cb54270e-7858-4e94-b1f5-218bbdf967df not found in is_blk_device check {{(pid=86148) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 15:47:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cb54270e-7858-4e94-b1f5-218bbdf967df {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:57 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cb54270e-7858-4e94-b1f5-218bbdf967df Jul 06 15:47:57 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:01 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:48:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Flow 'volume_create_manager' (21ff60b1-46ed-4f5c-a23e-f2f275a2d89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1e2c337-7c77-4b88-9263-0727c809f6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1e2c337-7c77-4b88-9263-0727c809f6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-486255860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00be9789-7540-495a-81f1-9b0c6d1335d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c024b5e94f48c694e7705e1c0ee617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:01Z,use_quota=True,user_id='2422d7879e5947eba2fd6880c67db83e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d27b48-6058-4a82-a272-d32fb81ed7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d27b48-6058-4a82-a272-d32fb81ed7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74007c38-2666-4ec6-9f9e-070c7fe3b977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74007c38-2666-4ec6-9f9e-070c7fe3b977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00be9789-7540-495a-81f1-9b0c6d1335d5', 'volume_name': 'volume-00be9789-7540-495a-81f1-9b0c6d1335d5', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a020f10-a71f-4e50-a225-4a2ccb1abf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a020f10-a71f-4e50-a225-4a2ccb1abf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6186085d-5832-4b15-8be9-874bdace99ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:01 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Volume 00be9789-7540-495a-81f1-9b0c6d1335d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00be9789-7540-495a-81f1-9b0c6d1335d5', 'volume_size': 1} Jul 06 15:48:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:03 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cb54270e-7858-4e94-b1f5-218bbdf967df" returned: 0 in 5.724s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:03 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[139a4e96-d7ec-4363-99d4-e9ad717c8421]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:03 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:UPDATE=210,cinder:SELECT=152,cinder:DELETE=18,cinder:INSERT=58 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:48:03 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a Jul 06 15:48:03 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:03 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=154,cinder:UPDATE=195,cinder:INSERT=54,cinder:DELETE=19 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:48:03 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:48:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Flow 'volume_create_manager' (04ea792f-a130-4110-9ed9-e70979fd314c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc8ebdee-bac5-427b-bbe1-636b61a96923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc8ebdee-bac5-427b-bbe1-636b61a96923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1206760460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00870aaf-b7d1-4ddf-807d-22bb3e534e09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8b0711e23d241049243d47bc14e1aac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:04Z,use_quota=True,user_id='d4c04fa0d44d41758d3096bebab1c7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c9ab7c8-6040-49d1-bed7-579026f64af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c9ab7c8-6040-49d1-bed7-579026f64af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89aeef32-a605-4320-b6da-589f2799fb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89aeef32-a605-4320-b6da-589f2799fb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00870aaf-b7d1-4ddf-807d-22bb3e534e09', 'volume_name': 'volume-00870aaf-b7d1-4ddf-807d-22bb3e534e09', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc085fe-666f-4899-a5bc-3f2ad222965a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc085fe-666f-4899-a5bc-3f2ad222965a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (052f84d4-b512-491b-bf61-397799bcec03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:03 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Volume 00870aaf-b7d1-4ddf-807d-22bb3e534e09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00870aaf-b7d1-4ddf-807d-22bb3e534e09', 'volume_size': 1} Jul 06 15:48:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:04 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a" returned: 0 in 0.903s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:04 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cb54270e-7858-4e94-b1f5-218bbdf967df {{(pid=86148) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:48:04 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Converted 1024.00 MB image at 178.83 MB/s Jul 06 15:48:04 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cb54270e-7858-4e94-b1f5-218bbdf967df is being set with open permissions: ugo+rw Jul 06 15:48:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cb54270e-7858-4e94-b1f5-218bbdf967df {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:04 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cb54270e-7858-4e94-b1f5-218bbdf967df Jul 06 15:48:04 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:05 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cb54270e-7858-4e94-b1f5-218bbdf967df" returned: 0 in 0.732s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:05 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Lock "cinder-quobyte-cb54270e-7858-4e94-b1f5-218bbdf967df" released by "_copy_volume_from_snapshot" :: held 9.484s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:05 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Lock "cinder-quobyte-7c6f546b-b562-49fb-9295-c3fc8ab44ff1-cb54270e-7858-4e94-b1f5-218bbdf967df" released by "_create_volume_from_snapshot" :: held 9.550s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.614s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-82dbab15-c180-4f46-a3d5-4d7892065c7e tempest-ProjectMemberTests-765095290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.084s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:05 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-82dbab15-c180-4f46-a3d5-4d7892065c7e tempest-ProjectMemberTests-765095290 None] Creating offline snapshot 22d80575-ac0a-4fdb-9396-9866e5ec759a of volume a78d77e1-a53f-418b-85d7-b24664a68064 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:48:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e0f3cc-dcf0-4418-af53-5f85456c6200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb54270e-7858-4e94-b1f5-218bbdf967df', 'volume_size': 1, 'snapshot_id': '7c6f546b-b562-49fb-9295-c3fc8ab44ff1'}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38430189-9989-4b60-9c3b-895e52b56172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:05 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a548298-3901-4043-b8e2-1b79459f1df2]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-82dbab15-c180-4f46-a3d5-4d7892065c7e tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:05 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Volume volume-cb54270e-7858-4e94-b1f5-218bbdf967df (cb54270e-7858-4e94-b1f5-218bbdf967df): created successfully Jul 06 15:48:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38430189-9989-4b60-9c3b-895e52b56172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:05 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Flow 'volume_create_manager' (57e36b71-9785-4330-b0e0-2b275b06dc3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:05 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a2e1e121-1e0b-4a0e-a8ab-92c7ed498b7d tempest-VolumeDependencyTests-877105953 None] Created volume successfully. Jul 06 15:48:05 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064 Jul 06 15:48:05 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:05 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-82dbab15-c180-4f46-a3d5-4d7892065c7e tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064" returned: 0 in 0.741s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-82dbab15-c180-4f46-a3d5-4d7892065c7e tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064.22d80575-ac0a-4fdb-9396-9866e5ec759a 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:05 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064.22d80575-ac0a-4fdb-9396-9866e5ec759a 1G Jul 06 15:48:05 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:06 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ad5a171a-ce92-43d3-ac9d-8a2edcf44183 tempest-VolumeDependencyTests-877105953 None] Acquiring lock "cinder-7c6f546b-b562-49fb-9295-c3fc8ab44ff1-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:06 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ad5a171a-ce92-43d3-ac9d-8a2edcf44183 tempest-VolumeDependencyTests-877105953 None] Lock "cinder-7c6f546b-b562-49fb-9295-c3fc8ab44ff1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:06 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ad5a171a-ce92-43d3-ac9d-8a2edcf44183 tempest-VolumeDependencyTests-877105953 None] Acquiring lock "cinder-quobyte-ab0decda-c706-482a-b650-9164465c751a" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:06 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ad5a171a-ce92-43d3-ac9d-8a2edcf44183 tempest-VolumeDependencyTests-877105953 None] Lock "cinder-quobyte-ab0decda-c706-482a-b650-9164465c751a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:06 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ad5a171a-ce92-43d3-ac9d-8a2edcf44183 tempest-VolumeDependencyTests-877105953 None] Acquiring lock "cinder-quobyte-7c6f546b-b562-49fb-9295-c3fc8ab44ff1" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:06 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ad5a171a-ce92-43d3-ac9d-8a2edcf44183 tempest-VolumeDependencyTests-877105953 None] Lock "cinder-quobyte-7c6f546b-b562-49fb-9295-c3fc8ab44ff1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:06 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-ad5a171a-ce92-43d3-ac9d-8a2edcf44183 tempest-VolumeDependencyTests-877105953 None] Deleting offline snapshot 7c6f546b-b562-49fb-9295-c3fc8ab44ff1 of volume ab0decda-c706-482a-b650-9164465c751a {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:48:06 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-ad5a171a-ce92-43d3-ac9d-8a2edcf44183 tempest-VolumeDependencyTests-877105953 None] snapshot_file for this snap is: volume-ab0decda-c706-482a-b650-9164465c751a.7c6f546b-b562-49fb-9295-c3fc8ab44ff1 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:48:06 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[b411e746-f688-47db-8208-1d5686495e3e]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ad5a171a-ce92-43d3-ac9d-8a2edcf44183 tempest-VolumeDependencyTests-877105953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.7c6f546b-b562-49fb-9295-c3fc8ab44ff1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:06 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.7c6f546b-b562-49fb-9295-c3fc8ab44ff1 Jul 06 15:48:06 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:06 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-82dbab15-c180-4f46-a3d5-4d7892065c7e tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064.22d80575-ac0a-4fdb-9396-9866e5ec759a 1G" returned: 0 in 0.897s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-82dbab15-c180-4f46-a3d5-4d7892065c7e tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a78d77e1-a53f-418b-85d7-b24664a68064 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064.22d80575-ac0a-4fdb-9396-9866e5ec759a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:06 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a78d77e1-a53f-418b-85d7-b24664a68064 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064.22d80575-ac0a-4fdb-9396-9866e5ec759a Jul 06 15:48:06 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:07 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ad5a171a-ce92-43d3-ac9d-8a2edcf44183 tempest-VolumeDependencyTests-877105953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.7c6f546b-b562-49fb-9295-c3fc8ab44ff1" returned: 0 in 0.831s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-ad5a171a-ce92-43d3-ac9d-8a2edcf44183 tempest-VolumeDependencyTests-877105953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab0decda-c706-482a-b650-9164465c751a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:48:07 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7877f4f-cf8d-42f6-acd0-c8077794bfa4]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ad5a171a-ce92-43d3-ac9d-8a2edcf44183 tempest-VolumeDependencyTests-877105953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:07 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a Jul 06 15:48:07 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:07 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-82dbab15-c180-4f46-a3d5-4d7892065c7e tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a78d77e1-a53f-418b-85d7-b24664a68064 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064.22d80575-ac0a-4fdb-9396-9866e5ec759a" returned: 0 in 0.749s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:07 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-82dbab15-c180-4f46-a3d5-4d7892065c7e tempest-ProjectMemberTests-765095290 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064.22d80575-ac0a-4fdb-9396-9866e5ec759a is being set with open permissions: ugo+rw Jul 06 15:48:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-82dbab15-c180-4f46-a3d5-4d7892065c7e tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064.22d80575-ac0a-4fdb-9396-9866e5ec759a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:07 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064.22d80575-ac0a-4fdb-9396-9866e5ec759a Jul 06 15:48:07 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:07 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ad5a171a-ce92-43d3-ac9d-8a2edcf44183 tempest-VolumeDependencyTests-877105953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a" returned: 0 in 0.807s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ad5a171a-ce92-43d3-ac9d-8a2edcf44183 tempest-VolumeDependencyTests-877105953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.7c6f546b-b562-49fb-9295-c3fc8ab44ff1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:07 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.7c6f546b-b562-49fb-9295-c3fc8ab44ff1 Jul 06 15:48:07 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:08 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-82dbab15-c180-4f46-a3d5-4d7892065c7e tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064.22d80575-ac0a-4fdb-9396-9866e5ec759a" returned: 0 in 0.735s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-82dbab15-c180-4f46-a3d5-4d7892065c7e tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:08 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064.info Jul 06 15:48:08 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:08 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ad5a171a-ce92-43d3-ac9d-8a2edcf44183 tempest-VolumeDependencyTests-877105953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.7c6f546b-b562-49fb-9295-c3fc8ab44ff1" returned: 0 in 0.796s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ad5a171a-ce92-43d3-ac9d-8a2edcf44183 tempest-VolumeDependencyTests-877105953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.7c6f546b-b562-49fb-9295-c3fc8ab44ff1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:08 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.7c6f546b-b562-49fb-9295-c3fc8ab44ff1 Jul 06 15:48:08 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:09 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-82dbab15-c180-4f46-a3d5-4d7892065c7e tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064.info" returned: 0 in 0.734s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:09 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-82dbab15-c180-4f46-a3d5-4d7892065c7e tempest-ProjectMemberTests-765095290 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064.info is being set with open permissions: ugo+rw Jul 06 15:48:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-82dbab15-c180-4f46-a3d5-4d7892065c7e tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:09 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064.info Jul 06 15:48:09 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:09 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ad5a171a-ce92-43d3-ac9d-8a2edcf44183 tempest-VolumeDependencyTests-877105953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a.7c6f546b-b562-49fb-9295-c3fc8ab44ff1" returned: 0 in 0.714s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:09 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ad5a171a-ce92-43d3-ac9d-8a2edcf44183 tempest-VolumeDependencyTests-877105953 None] Lock "cinder-quobyte-7c6f546b-b562-49fb-9295-c3fc8ab44ff1" released by "_delete_snapshot" :: held 3.289s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:09 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ad5a171a-ce92-43d3-ac9d-8a2edcf44183 tempest-VolumeDependencyTests-877105953 None] Lock "cinder-quobyte-ab0decda-c706-482a-b650-9164465c751a" released by "delete_snapshot" :: held 3.318s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:09 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-ad5a171a-ce92-43d3-ac9d-8a2edcf44183 tempest-VolumeDependencyTests-877105953 None] Created reservations ['fb10a02d-63b7-4710-b9ec-000ce2b52076', '41d5dc27-aef0-489f-b3dc-5e6c436c30e3', '2c95b600-3b96-4ee2-8d12-ba7bfb2178fc', '69dd2e2a-2789-49a6-90a9-c53b068ac67c'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:09 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-ad5a171a-ce92-43d3-ac9d-8a2edcf44183 tempest-VolumeDependencyTests-877105953 None] Delete snapshot completed successfully. Jul 06 15:48:09 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ad5a171a-ce92-43d3-ac9d-8a2edcf44183 tempest-VolumeDependencyTests-877105953 None] Lock "cinder-7c6f546b-b562-49fb-9295-c3fc8ab44ff1-delete_snapshot" released by "delete_snapshot" :: held 3.555s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:09 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-82dbab15-c180-4f46-a3d5-4d7892065c7e tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064.info" returned: 0 in 0.705s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-82dbab15-c180-4f46-a3d5-4d7892065c7e tempest-ProjectMemberTests-765095290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.704s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.628s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-486255860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00be9789-7540-495a-81f1-9b0c6d1335d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c024b5e94f48c694e7705e1c0ee617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:01Z,use_quota=True,user_id='2422d7879e5947eba2fd6880c67db83e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:48:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Creating volume 00be9789-7540-495a-81f1-9b0c6d1335d5 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:48:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:48:09 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:48:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-00be9789-7540-495a-81f1-9b0c6d1335d5 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:09 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-00be9789-7540-495a-81f1-9b0c6d1335d5 1073741824 Jul 06 15:48:09 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:09 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-82dbab15-c180-4f46-a3d5-4d7892065c7e tempest-ProjectMemberTests-765095290 None] Create snapshot completed successfully Jul 06 15:48:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-054b676d-30d5-49d3-9ad3-5b18a3f9d1fe tempest-VolumeDependencyTests-877105953 None] Acquiring lock "cinder-ab0decda-c706-482a-b650-9164465c751a-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-054b676d-30d5-49d3-9ad3-5b18a3f9d1fe tempest-VolumeDependencyTests-877105953 None] Lock "cinder-ab0decda-c706-482a-b650-9164465c751a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-054b676d-30d5-49d3-9ad3-5b18a3f9d1fe tempest-VolumeDependencyTests-877105953 None] Acquiring lock "cinder-quobyte-ab0decda-c706-482a-b650-9164465c751a" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-054b676d-30d5-49d3-9ad3-5b18a3f9d1fe tempest-VolumeDependencyTests-877105953 None] Lock "cinder-quobyte-ab0decda-c706-482a-b650-9164465c751a" acquired by "delete_volume" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:10 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[8449847b-d0f1-4523-9792-13ae223bedc1]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-054b676d-30d5-49d3-9ad3-5b18a3f9d1fe tempest-VolumeDependencyTests-877105953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:10 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a Jul 06 15:48:10 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e9f08f87-cedb-4818-a8f2-47cdbc9397ce tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-22d80575-ac0a-4fdb-9396-9866e5ec759a-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e9f08f87-cedb-4818-a8f2-47cdbc9397ce tempest-ProjectMemberTests-765095290 None] Lock "cinder-22d80575-ac0a-4fdb-9396-9866e5ec759a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e9f08f87-cedb-4818-a8f2-47cdbc9397ce tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-quobyte-a78d77e1-a53f-418b-85d7-b24664a68064" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e9f08f87-cedb-4818-a8f2-47cdbc9397ce tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-a78d77e1-a53f-418b-85d7-b24664a68064" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e9f08f87-cedb-4818-a8f2-47cdbc9397ce tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-quobyte-22d80575-ac0a-4fdb-9396-9866e5ec759a" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e9f08f87-cedb-4818-a8f2-47cdbc9397ce tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-22d80575-ac0a-4fdb-9396-9866e5ec759a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:10 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:10 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-e9f08f87-cedb-4818-a8f2-47cdbc9397ce tempest-ProjectMemberTests-765095290 None] Deleting offline snapshot 22d80575-ac0a-4fdb-9396-9866e5ec759a of volume a78d77e1-a53f-418b-85d7-b24664a68064 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:48:10 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-e9f08f87-cedb-4818-a8f2-47cdbc9397ce tempest-ProjectMemberTests-765095290 None] snapshot_file for this snap is: volume-a78d77e1-a53f-418b-85d7-b24664a68064.22d80575-ac0a-4fdb-9396-9866e5ec759a {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:48:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-00be9789-7540-495a-81f1-9b0c6d1335d5 1073741824" returned: 0 in 0.968s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:10 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[146904f5-07c8-4877-a09f-c7fb862ea45e]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e9f08f87-cedb-4818-a8f2-47cdbc9397ce tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064.22d80575-ac0a-4fdb-9396-9866e5ec759a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-00be9789-7540-495a-81f1-9b0c6d1335d5 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:10 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-00be9789-7540-495a-81f1-9b0c6d1335d5 Jul 06 15:48:10 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:10 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064.22d80575-ac0a-4fdb-9396-9866e5ec759a Jul 06 15:48:10 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:11 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-054b676d-30d5-49d3-9ad3-5b18a3f9d1fe tempest-VolumeDependencyTests-877105953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a" returned: 0 in 0.804s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-054b676d-30d5-49d3-9ad3-5b18a3f9d1fe tempest-VolumeDependencyTests-877105953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:11 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a Jul 06 15:48:11 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:11 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-00be9789-7540-495a-81f1-9b0c6d1335d5" returned: 0 in 0.663s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:48:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.831s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1206760460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00870aaf-b7d1-4ddf-807d-22bb3e534e09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8b0711e23d241049243d47bc14e1aac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:04Z,use_quota=True,user_id='d4c04fa0d44d41758d3096bebab1c7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:48:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Creating volume 00870aaf-b7d1-4ddf-807d-22bb3e534e09 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:48:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:48:11 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:48:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-00870aaf-b7d1-4ddf-807d-22bb3e534e09 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6186085d-5832-4b15-8be9-874bdace99ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00be9789-7540-495a-81f1-9b0c6d1335d5', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4edb6a8-e35d-446c-8129-82aa69d14224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:11 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-00870aaf-b7d1-4ddf-807d-22bb3e534e09 1073741824 Jul 06 15:48:11 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:11 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Volume volume-00be9789-7540-495a-81f1-9b0c6d1335d5 (00be9789-7540-495a-81f1-9b0c6d1335d5): created successfully Jul 06 15:48:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4edb6a8-e35d-446c-8129-82aa69d14224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:11 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Flow 'volume_create_manager' (21ff60b1-46ed-4f5c-a23e-f2f275a2d89d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:11 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-20bd4617-0948-4e01-97ec-467febed1f6b tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Created volume successfully. Jul 06 15:48:11 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e9f08f87-cedb-4818-a8f2-47cdbc9397ce tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064.22d80575-ac0a-4fdb-9396-9866e5ec759a" returned: 0 in 0.945s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-e9f08f87-cedb-4818-a8f2-47cdbc9397ce tempest-ProjectMemberTests-765095290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a78d77e1-a53f-418b-85d7-b24664a68064(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:48:11 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[be826e24-9f25-419c-8a2e-ee4f31d48e50]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e9f08f87-cedb-4818-a8f2-47cdbc9397ce tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:11 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064 Jul 06 15:48:11 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:11 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-054b676d-30d5-49d3-9ad3-5b18a3f9d1fe tempest-VolumeDependencyTests-877105953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-ab0decda-c706-482a-b650-9164465c751a" returned: 0 in 0.695s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:11 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-054b676d-30d5-49d3-9ad3-5b18a3f9d1fe tempest-VolumeDependencyTests-877105953 None] Lock "cinder-quobyte-ab0decda-c706-482a-b650-9164465c751a" released by "delete_volume" :: held 1.562s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:12 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-054b676d-30d5-49d3-9ad3-5b18a3f9d1fe tempest-VolumeDependencyTests-877105953 None] Created reservations ['1471b829-eb0b-4805-be0c-a32b0cfc3b74', '318d49b3-5d71-4a30-a8ab-b153a63e6958', 'cf087ecd-4758-4529-9efc-8c48e31ea4c5', 'fabd3d75-84d4-4953-bd9e-ee9638a828f0'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-054b676d-30d5-49d3-9ad3-5b18a3f9d1fe tempest-VolumeDependencyTests-877105953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-054b676d-30d5-49d3-9ad3-5b18a3f9d1fe tempest-VolumeDependencyTests-877105953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-054b676d-30d5-49d3-9ad3-5b18a3f9d1fe tempest-VolumeDependencyTests-877105953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:12 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-054b676d-30d5-49d3-9ad3-5b18a3f9d1fe tempest-VolumeDependencyTests-877105953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-054b676d-30d5-49d3-9ad3-5b18a3f9d1fe tempest-VolumeDependencyTests-877105953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-054b676d-30d5-49d3-9ad3-5b18a3f9d1fe tempest-VolumeDependencyTests-877105953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:12 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:48:12 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:12 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-00870aaf-b7d1-4ddf-807d-22bb3e534e09 1073741824" returned: 0 in 0.956s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-00870aaf-b7d1-4ddf-807d-22bb3e534e09 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:12 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-00870aaf-b7d1-4ddf-807d-22bb3e534e09 Jul 06 15:48:12 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:12 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-0a9b7f7b-9094-4eda-8abd-d4db1b4ebebc tempest-VolumeDependencyTests-877105953 None] Acquiring lock "cinder-cb54270e-7858-4e94-b1f5-218bbdf967df-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:12 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-0a9b7f7b-9094-4eda-8abd-d4db1b4ebebc tempest-VolumeDependencyTests-877105953 None] Lock "cinder-cb54270e-7858-4e94-b1f5-218bbdf967df-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:12 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-0a9b7f7b-9094-4eda-8abd-d4db1b4ebebc tempest-VolumeDependencyTests-877105953 None] Acquiring lock "cinder-quobyte-cb54270e-7858-4e94-b1f5-218bbdf967df" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:12 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-0a9b7f7b-9094-4eda-8abd-d4db1b4ebebc tempest-VolumeDependencyTests-877105953 None] Lock "cinder-quobyte-cb54270e-7858-4e94-b1f5-218bbdf967df" acquired by "delete_volume" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:12 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e9f08f87-cedb-4818-a8f2-47cdbc9397ce tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064" returned: 0 in 0.987s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e9f08f87-cedb-4818-a8f2-47cdbc9397ce tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064.22d80575-ac0a-4fdb-9396-9866e5ec759a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:12 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[684dfb00-1c2a-47a7-83e0-f92458724e43]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a9b7f7b-9094-4eda-8abd-d4db1b4ebebc tempest-VolumeDependencyTests-877105953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cb54270e-7858-4e94-b1f5-218bbdf967df {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:12 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064.22d80575-ac0a-4fdb-9396-9866e5ec759a Jul 06 15:48:12 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:12 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cb54270e-7858-4e94-b1f5-218bbdf967df Jul 06 15:48:12 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:13 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-054b676d-30d5-49d3-9ad3-5b18a3f9d1fe tempest-VolumeDependencyTests-877105953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.872s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-054b676d-30d5-49d3-9ad3-5b18a3f9d1fe tempest-VolumeDependencyTests-877105953 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:48:13 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-054b676d-30d5-49d3-9ad3-5b18a3f9d1fe tempest-VolumeDependencyTests-877105953 None] Deleted volume successfully. Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-054b676d-30d5-49d3-9ad3-5b18a3f9d1fe tempest-VolumeDependencyTests-877105953 None] Lock "cinder-ab0decda-c706-482a-b650-9164465c751a-delete_volume" released by "delete_volume" :: held 2.687s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Flow 'volume_create_manager' (6f8ac36f-1b8c-4dae-839b-a18e63f10229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23af7b6-d08f-4a5b-a27a-65600d06f6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23af7b6-d08f-4a5b-a27a-65600d06f6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-898413663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25794182-2ca0-4eef-8bb2-4d4e9aeb0158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c024b5e94f48c694e7705e1c0ee617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:13Z,use_quota=True,user_id='2422d7879e5947eba2fd6880c67db83e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:13 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f8a16d-153e-4491-9864-d44a3f8c6fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f8a16d-153e-4491-9864-d44a3f8c6fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e06c571-9be2-40ae-a134-602e1b74b2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e06c571-9be2-40ae-a134-602e1b74b2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25794182-2ca0-4eef-8bb2-4d4e9aeb0158', 'volume_name': 'volume-25794182-2ca0-4eef-8bb2-4d4e9aeb0158', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d20160-8fa2-4416-a289-e14560850c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d20160-8fa2-4416-a289-e14560850c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dea05d5-1ba4-4d97-8fc5-f547880d2fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:13 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Volume 25794182-2ca0-4eef-8bb2-4d4e9aeb0158: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25794182-2ca0-4eef-8bb2-4d4e9aeb0158', 'volume_size': 1} Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-00870aaf-b7d1-4ddf-807d-22bb3e534e09" returned: 0 in 1.130s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] <== create_volume: return (2155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.159s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-898413663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25794182-2ca0-4eef-8bb2-4d4e9aeb0158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c024b5e94f48c694e7705e1c0ee617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:13Z,use_quota=True,user_id='2422d7879e5947eba2fd6880c67db83e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Creating volume 25794182-2ca0-4eef-8bb2-4d4e9aeb0158 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:48:13 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-25794182-2ca0-4eef-8bb2-4d4e9aeb0158 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:13 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-25794182-2ca0-4eef-8bb2-4d4e9aeb0158 1073741824 Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (052f84d4-b512-491b-bf61-397799bcec03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00870aaf-b7d1-4ddf-807d-22bb3e534e09', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:13 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee3b362-eb99-46e5-8a71-626794e8ebba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:13 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:13 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Volume volume-00870aaf-b7d1-4ddf-807d-22bb3e534e09 (00870aaf-b7d1-4ddf-807d-22bb3e534e09): created successfully Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee3b362-eb99-46e5-8a71-626794e8ebba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Flow 'volume_create_manager' (04ea792f-a130-4110-9ed9-e70979fd314c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e9f08f87-cedb-4818-a8f2-47cdbc9397ce tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064.22d80575-ac0a-4fdb-9396-9866e5ec759a" returned: 0 in 1.005s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e9f08f87-cedb-4818-a8f2-47cdbc9397ce tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064.22d80575-ac0a-4fdb-9396-9866e5ec759a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:13 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-663f0ad1-9fc5-4d12-b4d9-45577d08c963 tempest-ProjectReaderTests-1147876465 None] Created volume successfully. Jul 06 15:48:13 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064.22d80575-ac0a-4fdb-9396-9866e5ec759a Jul 06 15:48:13 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:13 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a9b7f7b-9094-4eda-8abd-d4db1b4ebebc tempest-VolumeDependencyTests-877105953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cb54270e-7858-4e94-b1f5-218bbdf967df" returned: 0 in 1.176s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a9b7f7b-9094-4eda-8abd-d4db1b4ebebc tempest-VolumeDependencyTests-877105953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cb54270e-7858-4e94-b1f5-218bbdf967df {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:14 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cb54270e-7858-4e94-b1f5-218bbdf967df Jul 06 15:48:14 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Flow 'volume_create_manager' (bffe4f29-42ef-41e4-b59d-d6c044fb7ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c39cccb5-aa96-471f-810e-c55b7064b058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c39cccb5-aa96-471f-810e-c55b7064b058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-865898047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91825226-8576-49bb-aa70-3df51244ab68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c024b5e94f48c694e7705e1c0ee617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:14Z,use_quota=True,user_id='2422d7879e5947eba2fd6880c67db83e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96fcbeb4-2d53-416b-b190-8c6575347a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96fcbeb4-2d53-416b-b190-8c6575347a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df5c308-03a7-4f5e-837c-6af7719f0373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df5c308-03a7-4f5e-837c-6af7719f0373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91825226-8576-49bb-aa70-3df51244ab68', 'volume_name': 'volume-91825226-8576-49bb-aa70-3df51244ab68', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa7a1e37-79f4-4058-8235-7ce17b3b265f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa7a1e37-79f4-4058-8235-7ce17b3b265f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (725f9d30-7b57-42c5-9988-d03724722f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:14 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Volume 91825226-8576-49bb-aa70-3df51244ab68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91825226-8576-49bb-aa70-3df51244ab68', 'volume_size': 1} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Flow 'volume_create_manager' (24b1aa3c-7440-43ba-a1dd-a4a1b77488a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5285c8a9-a75d-4006-99b7-2531c0c853e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5285c8a9-a75d-4006-99b7-2531c0c853e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2135282462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d77dea28-c841-4d1f-8a65-26b5ebc95c0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c024b5e94f48c694e7705e1c0ee617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:14Z,use_quota=True,user_id='2422d7879e5947eba2fd6880c67db83e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa67fd5-9b33-4e1e-b7e8-dab033e552d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa67fd5-9b33-4e1e-b7e8-dab033e552d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a1fcb23-dd82-4453-afbc-84d6ce4f258e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a1fcb23-dd82-4453-afbc-84d6ce4f258e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd77dea28-c841-4d1f-8a65-26b5ebc95c0d', 'volume_name': 'volume-d77dea28-c841-4d1f-8a65-26b5ebc95c0d', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38286594-805a-4b18-bf41-daccfe35801a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38286594-805a-4b18-bf41-daccfe35801a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130430c6-0831-46ee-a928-c2ae904b1f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:14 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Volume d77dea28-c841-4d1f-8a65-26b5ebc95c0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d77dea28-c841-4d1f-8a65-26b5ebc95c0d', 'volume_size': 1} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-da765733-c9d3-49e3-a17d-7729efc145c5 tempest-ProjectReaderTests-1147876465 None] Acquiring lock "cinder-00870aaf-b7d1-4ddf-807d-22bb3e534e09-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-da765733-c9d3-49e3-a17d-7729efc145c5 tempest-ProjectReaderTests-1147876465 None] Lock "cinder-00870aaf-b7d1-4ddf-807d-22bb3e534e09-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-da765733-c9d3-49e3-a17d-7729efc145c5 tempest-ProjectReaderTests-1147876465 None] Acquiring lock "cinder-quobyte-00870aaf-b7d1-4ddf-807d-22bb3e534e09" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-da765733-c9d3-49e3-a17d-7729efc145c5 tempest-ProjectReaderTests-1147876465 None] Lock "cinder-quobyte-00870aaf-b7d1-4ddf-807d-22bb3e534e09" acquired by "delete_volume" :: waited 0.020s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[83da325a-d560-4fe5-92e3-d52c87394b50]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-da765733-c9d3-49e3-a17d-7729efc145c5 tempest-ProjectReaderTests-1147876465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-00870aaf-b7d1-4ddf-807d-22bb3e534e09 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:14 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e9f08f87-cedb-4818-a8f2-47cdbc9397ce tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064.22d80575-ac0a-4fdb-9396-9866e5ec759a" returned: 0 in 1.200s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e9f08f87-cedb-4818-a8f2-47cdbc9397ce tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-22d80575-ac0a-4fdb-9396-9866e5ec759a" released by "_delete_snapshot" :: held 4.328s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e9f08f87-cedb-4818-a8f2-47cdbc9397ce tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-a78d77e1-a53f-418b-85d7-b24664a68064" released by "delete_snapshot" :: held 4.374s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:15 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-00870aaf-b7d1-4ddf-807d-22bb3e534e09 Jul 06 15:48:15 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:15 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-25794182-2ca0-4eef-8bb2-4d4e9aeb0158 1073741824" returned: 0 in 1.460s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-25794182-2ca0-4eef-8bb2-4d4e9aeb0158 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:15 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-25794182-2ca0-4eef-8bb2-4d4e9aeb0158 Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:48:15 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:15 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Flow 'volume_create_manager' (4a0c94b3-c075-41bd-8609-966c455a3131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (656f23e3-a67a-4dd3-9da6-b4cdc74fa844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a9b7f7b-9094-4eda-8abd-d4db1b4ebebc tempest-VolumeDependencyTests-877105953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cb54270e-7858-4e94-b1f5-218bbdf967df" returned: 0 in 1.341s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (656f23e3-a67a-4dd3-9da6-b4cdc74fa844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2025558859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a88cd2b6-1a5a-4e4b-ba48-092ea6db25eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c024b5e94f48c694e7705e1c0ee617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:15Z,use_quota=True,user_id='2422d7879e5947eba2fd6880c67db83e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a11218a3-7931-47ee-a5c6-b3086bb96ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a11218a3-7931-47ee-a5c6-b3086bb96ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc0fd1b-35d0-44e5-b6f4-6d40f93660a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc0fd1b-35d0-44e5-b6f4-6d40f93660a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a88cd2b6-1a5a-4e4b-ba48-092ea6db25eb', 'volume_name': 'volume-a88cd2b6-1a5a-4e4b-ba48-092ea6db25eb', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d506eaea-27f8-49b2-8e3e-b4d6a8ee375a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d506eaea-27f8-49b2-8e3e-b4d6a8ee375a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (041bf1bf-a731-4d8c-a250-b150f7227b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:15 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Volume a88cd2b6-1a5a-4e4b-ba48-092ea6db25eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a88cd2b6-1a5a-4e4b-ba48-092ea6db25eb', 'volume_size': 1} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-e9f08f87-cedb-4818-a8f2-47cdbc9397ce tempest-ProjectMemberTests-765095290 None] Created reservations ['db7ca4fa-9c15-43a8-941d-53b3797b0f79', '3dfcae02-548e-457f-8995-a06b64b751de', '47f8f58c-b8a4-46b8-ba10-a9f45416d5d3', '6dd3f86c-b80f-42fc-bbe2-d7e0c47a87d6'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-0a9b7f7b-9094-4eda-8abd-d4db1b4ebebc tempest-VolumeDependencyTests-877105953 None] Lock "cinder-quobyte-cb54270e-7858-4e94-b1f5-218bbdf967df" released by "delete_volume" :: held 2.662s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Flow 'volume_create_manager' (989c1925-9bec-43ea-aebf-fa00da0b4d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12223f4e-d5da-4b5a-9c9b-93f849929fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12223f4e-d5da-4b5a-9c9b-93f849929fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-926854525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd4fcd4-5791-4ce6-a41f-cac2658116bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c024b5e94f48c694e7705e1c0ee617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:15Z,use_quota=True,user_id='2422d7879e5947eba2fd6880c67db83e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd07097-a6f7-4cfa-ac43-ccb15286d790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd07097-a6f7-4cfa-ac43-ccb15286d790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87877afd-67c5-41fc-855a-75aadfe9ab07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87877afd-67c5-41fc-855a-75aadfe9ab07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bd4fcd4-5791-4ce6-a41f-cac2658116bf', 'volume_name': 'volume-6bd4fcd4-5791-4ce6-a41f-cac2658116bf', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ad151ec-6c25-4ba5-807b-03b91c83031b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ad151ec-6c25-4ba5-807b-03b91c83031b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a098bd66-a67e-43b3-8dfe-83b3cf0026cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:15 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Volume 6bd4fcd4-5791-4ce6-a41f-cac2658116bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bd4fcd4-5791-4ce6-a41f-cac2658116bf', 'volume_size': 1} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:15 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-e9f08f87-cedb-4818-a8f2-47cdbc9397ce tempest-ProjectMemberTests-765095290 None] Delete snapshot completed successfully. Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e9f08f87-cedb-4818-a8f2-47cdbc9397ce tempest-ProjectMemberTests-765095290 None] Lock "cinder-22d80575-ac0a-4fdb-9396-9866e5ec759a-delete_snapshot" released by "delete_snapshot" :: held 4.926s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-0a9b7f7b-9094-4eda-8abd-d4db1b4ebebc tempest-VolumeDependencyTests-877105953 None] Created reservations ['ab284ad3-657d-4d56-814d-f0e721a5acbb', '6641abeb-46e1-4889-bf0b-231b5cfb61b0', '0314682f-e55c-4986-814a-6f9650462e1a', '4b026d75-d022-487e-892b-a708dce9f7aa'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0a9b7f7b-9094-4eda-8abd-d4db1b4ebebc tempest-VolumeDependencyTests-877105953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0a9b7f7b-9094-4eda-8abd-d4db1b4ebebc tempest-VolumeDependencyTests-877105953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0a9b7f7b-9094-4eda-8abd-d4db1b4ebebc tempest-VolumeDependencyTests-877105953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0a9b7f7b-9094-4eda-8abd-d4db1b4ebebc tempest-VolumeDependencyTests-877105953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0a9b7f7b-9094-4eda-8abd-d4db1b4ebebc tempest-VolumeDependencyTests-877105953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a9b7f7b-9094-4eda-8abd-d4db1b4ebebc tempest-VolumeDependencyTests-877105953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:15 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:48:15 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:15 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-da765733-c9d3-49e3-a17d-7729efc145c5 tempest-ProjectReaderTests-1147876465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-00870aaf-b7d1-4ddf-807d-22bb3e534e09" returned: 0 in 1.093s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-da765733-c9d3-49e3-a17d-7729efc145c5 tempest-ProjectReaderTests-1147876465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-00870aaf-b7d1-4ddf-807d-22bb3e534e09 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:16 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-00870aaf-b7d1-4ddf-807d-22bb3e534e09 Jul 06 15:48:16 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:16 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-25794182-2ca0-4eef-8bb2-4d4e9aeb0158" returned: 0 in 0.801s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:16 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] <== create_volume: return (2356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:48:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.360s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.884s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:16 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-865898047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91825226-8576-49bb-aa70-3df51244ab68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c024b5e94f48c694e7705e1c0ee617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:14Z,use_quota=True,user_id='2422d7879e5947eba2fd6880c67db83e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:48:16 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Creating volume 91825226-8576-49bb-aa70-3df51244ab68 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:48:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:16 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:16 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:16 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:48:16 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:48:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-91825226-8576-49bb-aa70-3df51244ab68 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dea05d5-1ba4-4d97-8fc5-f547880d2fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25794182-2ca0-4eef-8bb2-4d4e9aeb0158', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e046bfd-85db-4813-b79b-7bec297b9936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:16 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-91825226-8576-49bb-aa70-3df51244ab68 1073741824 Jul 06 15:48:16 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:16 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Volume volume-25794182-2ca0-4eef-8bb2-4d4e9aeb0158 (25794182-2ca0-4eef-8bb2-4d4e9aeb0158): created successfully Jul 06 15:48:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e046bfd-85db-4813-b79b-7bec297b9936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Flow 'volume_create_manager' (6f8ac36f-1b8c-4dae-839b-a18e63f10229) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:16 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-5cec82bd-098b-46ae-87ff-c3ae5371bcb2 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Created volume successfully. Jul 06 15:48:16 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-7b34a199-e271-4a1c-8b91-c8140e7de55a tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-a78d77e1-a53f-418b-85d7-b24664a68064-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:16 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-7b34a199-e271-4a1c-8b91-c8140e7de55a tempest-ProjectMemberTests-765095290 None] Lock "cinder-a78d77e1-a53f-418b-85d7-b24664a68064-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:16 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-7b34a199-e271-4a1c-8b91-c8140e7de55a tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-quobyte-a78d77e1-a53f-418b-85d7-b24664a68064" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:16 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-7b34a199-e271-4a1c-8b91-c8140e7de55a tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-a78d77e1-a53f-418b-85d7-b24664a68064" acquired by "delete_volume" :: waited 0.028s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:16 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[506bfddb-729d-4a87-aa7d-075215387015]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7b34a199-e271-4a1c-8b91-c8140e7de55a tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:16 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064 Jul 06 15:48:16 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:16 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0a9b7f7b-9094-4eda-8abd-d4db1b4ebebc tempest-VolumeDependencyTests-877105953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.994s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:16 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-0a9b7f7b-9094-4eda-8abd-d4db1b4ebebc tempest-VolumeDependencyTests-877105953 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:48:16 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-0a9b7f7b-9094-4eda-8abd-d4db1b4ebebc tempest-VolumeDependencyTests-877105953 None] Deleted volume successfully. Jul 06 15:48:16 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-0a9b7f7b-9094-4eda-8abd-d4db1b4ebebc tempest-VolumeDependencyTests-877105953 None] Lock "cinder-cb54270e-7858-4e94-b1f5-218bbdf967df-delete_volume" released by "delete_volume" :: held 4.143s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:16 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-da765733-c9d3-49e3-a17d-7729efc145c5 tempest-ProjectReaderTests-1147876465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-00870aaf-b7d1-4ddf-807d-22bb3e534e09" returned: 0 in 0.940s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:16 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-da765733-c9d3-49e3-a17d-7729efc145c5 tempest-ProjectReaderTests-1147876465 None] Lock "cinder-quobyte-00870aaf-b7d1-4ddf-807d-22bb3e534e09" released by "delete_volume" :: held 2.092s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:17 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-da765733-c9d3-49e3-a17d-7729efc145c5 tempest-ProjectReaderTests-1147876465 None] Created reservations ['7354f48d-938b-42db-8d2e-151bf02aca9c', '817131de-9d54-44f6-91fc-224436770ad5', '3c264636-32bd-45ea-9d6b-223e33f1b36e', 'f97344c5-49b3-417a-a9d2-595429cf9d13'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-da765733-c9d3-49e3-a17d-7729efc145c5 tempest-ProjectReaderTests-1147876465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-da765733-c9d3-49e3-a17d-7729efc145c5 tempest-ProjectReaderTests-1147876465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:17 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-da765733-c9d3-49e3-a17d-7729efc145c5 tempest-ProjectReaderTests-1147876465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:17 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-da765733-c9d3-49e3-a17d-7729efc145c5 tempest-ProjectReaderTests-1147876465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-da765733-c9d3-49e3-a17d-7729efc145c5 tempest-ProjectReaderTests-1147876465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-da765733-c9d3-49e3-a17d-7729efc145c5 tempest-ProjectReaderTests-1147876465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:17 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:48:17 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:17 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-91825226-8576-49bb-aa70-3df51244ab68 1073741824" returned: 0 in 1.336s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-91825226-8576-49bb-aa70-3df51244ab68 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:17 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-91825226-8576-49bb-aa70-3df51244ab68 Jul 06 15:48:17 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:17 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7b34a199-e271-4a1c-8b91-c8140e7de55a tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064" returned: 0 in 1.071s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7b34a199-e271-4a1c-8b91-c8140e7de55a tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:17 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064 Jul 06 15:48:17 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:18 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-da765733-c9d3-49e3-a17d-7729efc145c5 tempest-ProjectReaderTests-1147876465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.942s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-da765733-c9d3-49e3-a17d-7729efc145c5 tempest-ProjectReaderTests-1147876465 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:48:18 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-da765733-c9d3-49e3-a17d-7729efc145c5 tempest-ProjectReaderTests-1147876465 None] Deleted volume successfully. Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-da765733-c9d3-49e3-a17d-7729efc145c5 tempest-ProjectReaderTests-1147876465 None] Lock "cinder-00870aaf-b7d1-4ddf-807d-22bb3e534e09-delete_volume" released by "delete_volume" :: held 3.313s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:18 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-91825226-8576-49bb-aa70-3df51244ab68" returned: 0 in 0.870s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] <== create_volume: return (2292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.300s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.619s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2135282462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d77dea28-c841-4d1f-8a65-26b5ebc95c0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c024b5e94f48c694e7705e1c0ee617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:14Z,use_quota=True,user_id='2422d7879e5947eba2fd6880c67db83e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Creating volume d77dea28-c841-4d1f-8a65-26b5ebc95c0d {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:48:18 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d77dea28-c841-4d1f-8a65-26b5ebc95c0d 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:18 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7b34a199-e271-4a1c-8b91-c8140e7de55a tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a78d77e1-a53f-418b-85d7-b24664a68064" returned: 0 in 0.813s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:18 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d77dea28-c841-4d1f-8a65-26b5ebc95c0d 1073741824 Jul 06 15:48:18 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (725f9d30-7b57-42c5-9988-d03724722f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91825226-8576-49bb-aa70-3df51244ab68', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e03d60-1060-4ab9-ad29-0dd770fdcf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-7b34a199-e271-4a1c-8b91-c8140e7de55a tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-a78d77e1-a53f-418b-85d7-b24664a68064" released by "delete_volume" :: held 2.018s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:18 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Volume volume-91825226-8576-49bb-aa70-3df51244ab68 (91825226-8576-49bb-aa70-3df51244ab68): created successfully Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e03d60-1060-4ab9-ad29-0dd770fdcf13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Flow 'volume_create_manager' (bffe4f29-42ef-41e4-b59d-d6c044fb7ad7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:18 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-87935741-69fb-483b-9e8a-26fb8e96ce86 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Created volume successfully. Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-7b34a199-e271-4a1c-8b91-c8140e7de55a tempest-ProjectMemberTests-765095290 None] Created reservations ['902671fa-5700-4752-bfb1-56c8405c45ca', '410c8d52-fa8f-4193-9548-ecefae7a67b8', '80210228-0d7c-4ff8-a15a-a2a4e298c500', 'c460867b-2e24-4e8f-ab03-7f78e59d6e19'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7b34a199-e271-4a1c-8b91-c8140e7de55a tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7b34a199-e271-4a1c-8b91-c8140e7de55a tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-7b34a199-e271-4a1c-8b91-c8140e7de55a tempest-ProjectMemberTests-765095290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-7b34a199-e271-4a1c-8b91-c8140e7de55a tempest-ProjectMemberTests-765095290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7b34a199-e271-4a1c-8b91-c8140e7de55a tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7b34a199-e271-4a1c-8b91-c8140e7de55a tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:18 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:48:18 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Flow 'volume_create_manager' (4ab5de8b-6a26-4330-b5dd-10afb595e4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f1c3f9-6c23-4995-9d0e-f55c9f9c3833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f1c3f9-6c23-4995-9d0e-f55c9f9c3833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1937677826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0b87d2-2a58-491a-9010-3af646195f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8b0711e23d241049243d47bc14e1aac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:19Z,use_quota=True,user_id='d4c04fa0d44d41758d3096bebab1c7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb7c3a0-bd04-44aa-9857-76542795d199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb7c3a0-bd04-44aa-9857-76542795d199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (085c7fa5-2c16-4800-a040-d47508c543ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (085c7fa5-2c16-4800-a040-d47508c543ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f0b87d2-2a58-491a-9010-3af646195f24', 'volume_name': 'volume-2f0b87d2-2a58-491a-9010-3af646195f24', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c8b50e-db66-4a01-abce-0c0529d05b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c8b50e-db66-4a01-abce-0c0529d05b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c10f3ed7-2408-48e9-afae-67377164b112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:18 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Volume 2f0b87d2-2a58-491a-9010-3af646195f24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f0b87d2-2a58-491a-9010-3af646195f24', 'volume_size': 1} Jul 06 15:48:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:19 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d77dea28-c841-4d1f-8a65-26b5ebc95c0d 1073741824" returned: 0 in 1.011s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d77dea28-c841-4d1f-8a65-26b5ebc95c0d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:19 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d77dea28-c841-4d1f-8a65-26b5ebc95c0d Jul 06 15:48:19 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:19 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7b34a199-e271-4a1c-8b91-c8140e7de55a tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.799s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:19 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-7b34a199-e271-4a1c-8b91-c8140e7de55a tempest-ProjectMemberTests-765095290 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:48:19 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-7b34a199-e271-4a1c-8b91-c8140e7de55a tempest-ProjectMemberTests-765095290 None] Deleted volume successfully. Jul 06 15:48:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-7b34a199-e271-4a1c-8b91-c8140e7de55a tempest-ProjectMemberTests-765095290 None] Lock "cinder-a78d77e1-a53f-418b-85d7-b24664a68064-delete_volume" released by "delete_volume" :: held 3.200s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Flow 'volume_create_manager' (0f460733-06f4-403e-b2e7-af146fbaa08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a89b04c5-1462-4319-ba6d-d61496b4ec4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a89b04c5-1462-4319-ba6d-d61496b4ec4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80092285-8243-4d7d-8404-404f34d4525f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8725d669ac94d77bab448561d551574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:20Z,use_quota=True,user_id='99aa478ada954c79a6300ce5e551a7be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf8efd9-0d96-4f0f-8a71-682bc9436c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf8efd9-0d96-4f0f-8a71-682bc9436c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbcbc4bd-f156-43bd-b465-7e67440632e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbcbc4bd-f156-43bd-b465-7e67440632e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80092285-8243-4d7d-8404-404f34d4525f', 'volume_name': 'volume-80092285-8243-4d7d-8404-404f34d4525f', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1d4acec-b815-4680-a642-94dcc7e45a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1d4acec-b815-4680-a642-94dcc7e45a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c5ee682-11d5-4b14-90b7-431bcd198a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:20 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Volume 80092285-8243-4d7d-8404-404f34d4525f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80092285-8243-4d7d-8404-404f34d4525f', 'volume_size': 1} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:20 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d77dea28-c841-4d1f-8a65-26b5ebc95c0d" returned: 0 in 0.742s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.744s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2025558859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a88cd2b6-1a5a-4e4b-ba48-092ea6db25eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c024b5e94f48c694e7705e1c0ee617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:15Z,use_quota=True,user_id='2422d7879e5947eba2fd6880c67db83e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Creating volume a88cd2b6-1a5a-4e4b-ba48-092ea6db25eb {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:48:20 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a88cd2b6-1a5a-4e4b-ba48-092ea6db25eb 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130430c6-0831-46ee-a928-c2ae904b1f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d77dea28-c841-4d1f-8a65-26b5ebc95c0d', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:20 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a88cd2b6-1a5a-4e4b-ba48-092ea6db25eb 1073741824 Jul 06 15:48:20 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eeb19a1-0628-45df-91ab-a78ef9ba2e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:20 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Volume volume-d77dea28-c841-4d1f-8a65-26b5ebc95c0d (d77dea28-c841-4d1f-8a65-26b5ebc95c0d): created successfully Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eeb19a1-0628-45df-91ab-a78ef9ba2e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Flow 'volume_create_manager' (24b1aa3c-7440-43ba-a1dd-a4a1b77488a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:20 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-2020a179-1700-48b5-8f1d-9ef97db815f5 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Created volume successfully. Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Flow 'volume_create_manager' (8b08ef7c-00b6-4e5e-8eae-12320872797e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (470851bb-55ba-440b-a158-13db5d45af4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (470851bb-55ba-440b-a158-13db5d45af4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1149848291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df61febf-9da1-4adb-8302-a9db4b0be4a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2acfd7a95ae04e6a8c97cbd4d6771d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:20Z,use_quota=True,user_id='c8e50c716ff74461bb8f1c33607ef860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ccbb5d5-a6f1-4827-a189-30775a2430b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ccbb5d5-a6f1-4827-a189-30775a2430b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f054235-b2f6-4ab1-9ac4-e704344b26ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f054235-b2f6-4ab1-9ac4-e704344b26ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df61febf-9da1-4adb-8302-a9db4b0be4a4', 'volume_name': 'volume-df61febf-9da1-4adb-8302-a9db4b0be4a4', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76616569-5460-4004-920b-4a8d32046039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76616569-5460-4004-920b-4a8d32046039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96af64ae-bad9-4a6e-9ff8-6a66900efb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:20 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Volume df61febf-9da1-4adb-8302-a9db4b0be4a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df61febf-9da1-4adb-8302-a9db4b0be4a4', 'volume_size': 1} Jul 06 15:48:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:21 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a88cd2b6-1a5a-4e4b-ba48-092ea6db25eb 1073741824" returned: 0 in 0.931s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a88cd2b6-1a5a-4e4b-ba48-092ea6db25eb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:21 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a88cd2b6-1a5a-4e4b-ba48-092ea6db25eb Jul 06 15:48:21 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:21 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a88cd2b6-1a5a-4e4b-ba48-092ea6db25eb" returned: 0 in 0.634s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:48:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.154s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-926854525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd4fcd4-5791-4ce6-a41f-cac2658116bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c024b5e94f48c694e7705e1c0ee617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:15Z,use_quota=True,user_id='2422d7879e5947eba2fd6880c67db83e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:48:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Creating volume 6bd4fcd4-5791-4ce6-a41f-cac2658116bf {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:48:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:21 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:48:21 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:48:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6bd4fcd4-5791-4ce6-a41f-cac2658116bf 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:21 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6bd4fcd4-5791-4ce6-a41f-cac2658116bf 1073741824 Jul 06 15:48:21 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (041bf1bf-a731-4d8c-a250-b150f7227b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a88cd2b6-1a5a-4e4b-ba48-092ea6db25eb', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d59ebe25-0313-4890-87ac-9ef44c0f40a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:21 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Volume volume-a88cd2b6-1a5a-4e4b-ba48-092ea6db25eb (a88cd2b6-1a5a-4e4b-ba48-092ea6db25eb): created successfully Jul 06 15:48:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d59ebe25-0313-4890-87ac-9ef44c0f40a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:21 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Flow 'volume_create_manager' (4a0c94b3-c075-41bd-8609-966c455a3131) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:21 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-701a48eb-1f00-4981-a126-3ae794ba7f9a tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Created volume successfully. Jul 06 15:48:22 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6bd4fcd4-5791-4ce6-a41f-cac2658116bf 1073741824" returned: 0 in 0.859s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6bd4fcd4-5791-4ce6-a41f-cac2658116bf {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:22 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6bd4fcd4-5791-4ce6-a41f-cac2658116bf Jul 06 15:48:22 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:23 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6bd4fcd4-5791-4ce6-a41f-cac2658116bf" returned: 0 in 0.643s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:48:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.383s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1937677826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0b87d2-2a58-491a-9010-3af646195f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8b0711e23d241049243d47bc14e1aac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:19Z,use_quota=True,user_id='d4c04fa0d44d41758d3096bebab1c7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:48:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Creating volume 2f0b87d2-2a58-491a-9010-3af646195f24 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:48:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:48:23 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:48:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2f0b87d2-2a58-491a-9010-3af646195f24 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a098bd66-a67e-43b3-8dfe-83b3cf0026cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bd4fcd4-5791-4ce6-a41f-cac2658116bf', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:23 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2f0b87d2-2a58-491a-9010-3af646195f24 1073741824 Jul 06 15:48:23 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0803535-8ee0-41c7-9711-77abc4cc2fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:23 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Volume volume-6bd4fcd4-5791-4ce6-a41f-cac2658116bf (6bd4fcd4-5791-4ce6-a41f-cac2658116bf): created successfully Jul 06 15:48:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0803535-8ee0-41c7-9711-77abc4cc2fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Flow 'volume_create_manager' (989c1925-9bec-43ea-aebf-fa00da0b4d96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:23 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-3f1ebe64-13e3-4e1c-986c-98274560a5e4 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Created volume successfully. Jul 06 15:48:24 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2f0b87d2-2a58-491a-9010-3af646195f24 1073741824" returned: 0 in 0.845s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2f0b87d2-2a58-491a-9010-3af646195f24 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:24 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2f0b87d2-2a58-491a-9010-3af646195f24 Jul 06 15:48:24 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:24 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-3d60fdb8-9389-47ef-bd13-367e6a726d78 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "cinder-6bd4fcd4-5791-4ce6-a41f-cac2658116bf-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:24 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-3d60fdb8-9389-47ef-bd13-367e6a726d78 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "cinder-6bd4fcd4-5791-4ce6-a41f-cac2658116bf-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:24 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-3d60fdb8-9389-47ef-bd13-367e6a726d78 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "cinder-quobyte-6bd4fcd4-5791-4ce6-a41f-cac2658116bf" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:24 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-3d60fdb8-9389-47ef-bd13-367e6a726d78 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "cinder-quobyte-6bd4fcd4-5791-4ce6-a41f-cac2658116bf" acquired by "delete_volume" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:24 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc285c8-4b0b-4bbc-8b39-5541f2bffd9a]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3d60fdb8-9389-47ef-bd13-367e6a726d78 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6bd4fcd4-5791-4ce6-a41f-cac2658116bf {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:24 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6bd4fcd4-5791-4ce6-a41f-cac2658116bf Jul 06 15:48:24 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:24 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2f0b87d2-2a58-491a-9010-3af646195f24" returned: 0 in 0.685s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:48:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.792s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80092285-8243-4d7d-8404-404f34d4525f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8725d669ac94d77bab448561d551574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:20Z,use_quota=True,user_id='99aa478ada954c79a6300ce5e551a7be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:48:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Creating volume 80092285-8243-4d7d-8404-404f34d4525f {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:48:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:48:24 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:48:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-80092285-8243-4d7d-8404-404f34d4525f 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c10f3ed7-2408-48e9-afae-67377164b112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f0b87d2-2a58-491a-9010-3af646195f24', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:24 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-80092285-8243-4d7d-8404-404f34d4525f 1073741824 Jul 06 15:48:24 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1a85260-2d27-42fa-9c50-c68bb524c148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:24 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Volume volume-2f0b87d2-2a58-491a-9010-3af646195f24 (2f0b87d2-2a58-491a-9010-3af646195f24): created successfully Jul 06 15:48:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1a85260-2d27-42fa-9c50-c68bb524c148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:24 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Flow 'volume_create_manager' (4ab5de8b-6a26-4330-b5dd-10afb595e4fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:24 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-5ce1590a-744a-41aa-ad5c-cf786eb07ad5 tempest-ProjectReaderTests-1147876465 None] Created volume successfully. Jul 06 15:48:25 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:25 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-0c4a50d3-d1f2-4602-b55f-4f247a2b4e60 tempest-ProjectReaderTests-1147876465 None] Acquiring lock "cinder-2f0b87d2-2a58-491a-9010-3af646195f24-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3d60fdb8-9389-47ef-bd13-367e6a726d78 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6bd4fcd4-5791-4ce6-a41f-cac2658116bf" returned: 0 in 0.795s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3d60fdb8-9389-47ef-bd13-367e6a726d78 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6bd4fcd4-5791-4ce6-a41f-cac2658116bf {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:25 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-0c4a50d3-d1f2-4602-b55f-4f247a2b4e60 tempest-ProjectReaderTests-1147876465 None] Lock "cinder-2f0b87d2-2a58-491a-9010-3af646195f24-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:25 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6bd4fcd4-5791-4ce6-a41f-cac2658116bf Jul 06 15:48:25 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:25 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-0c4a50d3-d1f2-4602-b55f-4f247a2b4e60 tempest-ProjectReaderTests-1147876465 None] Acquiring lock "cinder-quobyte-2f0b87d2-2a58-491a-9010-3af646195f24" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:25 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-0c4a50d3-d1f2-4602-b55f-4f247a2b4e60 tempest-ProjectReaderTests-1147876465 None] Lock "cinder-quobyte-2f0b87d2-2a58-491a-9010-3af646195f24" acquired by "delete_volume" :: waited 0.023s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:25 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b1cc94-fb7b-4744-b445-cf876778d553]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0c4a50d3-d1f2-4602-b55f-4f247a2b4e60 tempest-ProjectReaderTests-1147876465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2f0b87d2-2a58-491a-9010-3af646195f24 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:25 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2f0b87d2-2a58-491a-9010-3af646195f24 Jul 06 15:48:25 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:25 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-80092285-8243-4d7d-8404-404f34d4525f 1073741824" returned: 0 in 0.908s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-80092285-8243-4d7d-8404-404f34d4525f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:25 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-80092285-8243-4d7d-8404-404f34d4525f Jul 06 15:48:25 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:26 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3d60fdb8-9389-47ef-bd13-367e6a726d78 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6bd4fcd4-5791-4ce6-a41f-cac2658116bf" returned: 0 in 0.698s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-3d60fdb8-9389-47ef-bd13-367e6a726d78 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "cinder-quobyte-6bd4fcd4-5791-4ce6-a41f-cac2658116bf" released by "delete_volume" :: held 1.535s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-3d60fdb8-9389-47ef-bd13-367e6a726d78 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Created reservations ['0e89c1f8-2664-4a06-8206-993e9f7607b2', '2bff31f5-235a-4a60-97d9-3edf1c6a1e40', '70bdedfd-def0-4549-8aa8-acaa3995f854', 'faa2b2cc-f4e7-42b1-9f07-b2f5f151150e'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3d60fdb8-9389-47ef-bd13-367e6a726d78 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3d60fdb8-9389-47ef-bd13-367e6a726d78 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3d60fdb8-9389-47ef-bd13-367e6a726d78 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3d60fdb8-9389-47ef-bd13-367e6a726d78 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3d60fdb8-9389-47ef-bd13-367e6a726d78 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3d60fdb8-9389-47ef-bd13-367e6a726d78 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:26 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:48:26 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:26 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0c4a50d3-d1f2-4602-b55f-4f247a2b4e60 tempest-ProjectReaderTests-1147876465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2f0b87d2-2a58-491a-9010-3af646195f24" returned: 0 in 0.825s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0c4a50d3-d1f2-4602-b55f-4f247a2b4e60 tempest-ProjectReaderTests-1147876465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2f0b87d2-2a58-491a-9010-3af646195f24 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:26 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2f0b87d2-2a58-491a-9010-3af646195f24 Jul 06 15:48:26 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:26 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-80092285-8243-4d7d-8404-404f34d4525f" returned: 0 in 0.681s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.202s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1149848291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df61febf-9da1-4adb-8302-a9db4b0be4a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2acfd7a95ae04e6a8c97cbd4d6771d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:20Z,use_quota=True,user_id='c8e50c716ff74461bb8f1c33607ef860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Creating volume df61febf-9da1-4adb-8302-a9db4b0be4a4 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:48:26 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c5ee682-11d5-4b14-90b7-431bcd198a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80092285-8243-4d7d-8404-404f34d4525f', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87d5f84-2c4e-42e2-93ea-45f97365b3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:26 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4 1073741824 Jul 06 15:48:26 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:26 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Volume volume-80092285-8243-4d7d-8404-404f34d4525f (80092285-8243-4d7d-8404-404f34d4525f): created successfully Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87d5f84-2c4e-42e2-93ea-45f97365b3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Flow 'volume_create_manager' (0f460733-06f4-403e-b2e7-af146fbaa08a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:26 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-85c12700-4079-4368-8395-bacf669bf7d9 tempest-CinderUnicodeTest-592723457 None] Created volume successfully. Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a04b29e3-724a-4e90-9c61-e3dde2350160 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "cinder-a88cd2b6-1a5a-4e4b-ba48-092ea6db25eb-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a04b29e3-724a-4e90-9c61-e3dde2350160 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "cinder-a88cd2b6-1a5a-4e4b-ba48-092ea6db25eb-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a04b29e3-724a-4e90-9c61-e3dde2350160 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "cinder-quobyte-a88cd2b6-1a5a-4e4b-ba48-092ea6db25eb" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a04b29e3-724a-4e90-9c61-e3dde2350160 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "cinder-quobyte-a88cd2b6-1a5a-4e4b-ba48-092ea6db25eb" acquired by "delete_volume" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c15439e-7db1-4b98-bbd9-5fc5b5c3d5ca]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a04b29e3-724a-4e90-9c61-e3dde2350160 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a88cd2b6-1a5a-4e4b-ba48-092ea6db25eb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:26 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3d60fdb8-9389-47ef-bd13-367e6a726d78 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.718s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3d60fdb8-9389-47ef-bd13-367e6a726d78 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:48:26 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-3d60fdb8-9389-47ef-bd13-367e6a726d78 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Deleted volume successfully. Jul 06 15:48:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-3d60fdb8-9389-47ef-bd13-367e6a726d78 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "cinder-6bd4fcd4-5791-4ce6-a41f-cac2658116bf-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:26 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a88cd2b6-1a5a-4e4b-ba48-092ea6db25eb Jul 06 15:48:26 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:27 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0c4a50d3-d1f2-4602-b55f-4f247a2b4e60 tempest-ProjectReaderTests-1147876465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2f0b87d2-2a58-491a-9010-3af646195f24" returned: 0 in 0.753s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:27 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-0c4a50d3-d1f2-4602-b55f-4f247a2b4e60 tempest-ProjectReaderTests-1147876465 None] Lock "cinder-quobyte-2f0b87d2-2a58-491a-9010-3af646195f24" released by "delete_volume" :: held 1.622s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:27 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-0c4a50d3-d1f2-4602-b55f-4f247a2b4e60 tempest-ProjectReaderTests-1147876465 None] Created reservations ['ae46e4c9-cfde-4d82-8725-1ac62d12f2d2', 'b4ce032c-3855-4537-8d9e-4f695a91024a', '2666f3f1-9f0e-43a5-965e-d9d6e20171a8', '0f4be6dc-94af-430e-b1f8-54355aca3520'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0c4a50d3-d1f2-4602-b55f-4f247a2b4e60 tempest-ProjectReaderTests-1147876465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0c4a50d3-d1f2-4602-b55f-4f247a2b4e60 tempest-ProjectReaderTests-1147876465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:27 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0c4a50d3-d1f2-4602-b55f-4f247a2b4e60 tempest-ProjectReaderTests-1147876465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:27 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-0c4a50d3-d1f2-4602-b55f-4f247a2b4e60 tempest-ProjectReaderTests-1147876465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-0c4a50d3-d1f2-4602-b55f-4f247a2b4e60 tempest-ProjectReaderTests-1147876465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0c4a50d3-d1f2-4602-b55f-4f247a2b4e60 tempest-ProjectReaderTests-1147876465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:27 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:48:27 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:27 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4 1073741824" returned: 0 in 0.980s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:27 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4 Jul 06 15:48:27 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:27 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a04b29e3-724a-4e90-9c61-e3dde2350160 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a88cd2b6-1a5a-4e4b-ba48-092ea6db25eb" returned: 0 in 0.922s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a04b29e3-724a-4e90-9c61-e3dde2350160 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a88cd2b6-1a5a-4e4b-ba48-092ea6db25eb {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:27 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a88cd2b6-1a5a-4e4b-ba48-092ea6db25eb Jul 06 15:48:27 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:28 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0c4a50d3-d1f2-4602-b55f-4f247a2b4e60 tempest-ProjectReaderTests-1147876465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.951s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-0c4a50d3-d1f2-4602-b55f-4f247a2b4e60 tempest-ProjectReaderTests-1147876465 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:48:28 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-0c4a50d3-d1f2-4602-b55f-4f247a2b4e60 tempest-ProjectReaderTests-1147876465 None] Deleted volume successfully. Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-0c4a50d3-d1f2-4602-b55f-4f247a2b4e60 tempest-ProjectReaderTests-1147876465 None] Lock "cinder-2f0b87d2-2a58-491a-9010-3af646195f24-delete_volume" released by "delete_volume" :: held 2.813s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:28 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4" returned: 0 in 0.836s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Flow 'volume_create_manager' (28525365-9213-4829-91d0-bf4388688b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d67198-7f0a-4296-8d98-89d1edc5757f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96af64ae-bad9-4a6e-9ff8-6a66900efb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df61febf-9da1-4adb-8302-a9db4b0be4a4', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37b2623-c4bd-4202-900d-8759ce00fdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d67198-7f0a-4296-8d98-89d1edc5757f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-766646317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a68fcca7-39ca-43bd-a9b4-f19704835908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8725d669ac94d77bab448561d551574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:28Z,use_quota=True,user_id='99aa478ada954c79a6300ce5e551a7be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb902e9-14a2-43d1-bbe6-acac4cc62fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb902e9-14a2-43d1-bbe6-acac4cc62fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12044598-9539-48e8-9844-aaafad0af065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12044598-9539-48e8-9844-aaafad0af065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a68fcca7-39ca-43bd-a9b4-f19704835908', 'volume_name': 'volume-a68fcca7-39ca-43bd-a9b4-f19704835908', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69deb229-3bc7-4e7f-a0d4-c11781d1219e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69deb229-3bc7-4e7f-a0d4-c11781d1219e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f6c9a3-068c-4430-b6e6-571399b43e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:28 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Volume a68fcca7-39ca-43bd-a9b4-f19704835908: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a68fcca7-39ca-43bd-a9b4-f19704835908', 'volume_size': 1} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-766646317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a68fcca7-39ca-43bd-a9b4-f19704835908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8725d669ac94d77bab448561d551574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:28Z,use_quota=True,user_id='99aa478ada954c79a6300ce5e551a7be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Creating volume a68fcca7-39ca-43bd-a9b4-f19704835908 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:48:28 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:28 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Volume volume-df61febf-9da1-4adb-8302-a9db4b0be4a4 (df61febf-9da1-4adb-8302-a9db4b0be4a4): created successfully Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37b2623-c4bd-4202-900d-8759ce00fdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:28 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908 1073741824 Jul 06 15:48:28 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Flow 'volume_create_manager' (8b08ef7c-00b6-4e5e-8eae-12320872797e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Flow 'volume_create_manager' (d0e39f28-32a4-4875-ab23-130675557076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (debb9558-b1f0-4e5b-a10f-43f24e649cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:28 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-118524d6-1fc4-4dab-9e72-aa91bc1e5206 tempest-ProjectMemberTests-765095290 None] Created volume successfully. Jul 06 15:48:28 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (debb9558-b1f0-4e5b-a10f-43f24e649cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-504047167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7bf10b2-abbc-43e6-b8ad-e4cb41db0968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8b0711e23d241049243d47bc14e1aac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:28Z,use_quota=True,user_id='d4c04fa0d44d41758d3096bebab1c7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74414c0c-97a0-4fbc-987c-8e1c58f01af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74414c0c-97a0-4fbc-987c-8e1c58f01af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb36acf7-1c09-4bf9-8887-be5b3413cbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb36acf7-1c09-4bf9-8887-be5b3413cbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7bf10b2-abbc-43e6-b8ad-e4cb41db0968', 'volume_name': 'volume-e7bf10b2-abbc-43e6-b8ad-e4cb41db0968', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047fa2d5-c0c8-41b7-9594-96d61accb4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047fa2d5-c0c8-41b7-9594-96d61accb4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a8f3f4-c234-4943-9b08-132ff1bdb8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:28 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Volume e7bf10b2-abbc-43e6-b8ad-e4cb41db0968: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7bf10b2-abbc-43e6-b8ad-e4cb41db0968', 'volume_size': 1} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a04b29e3-724a-4e90-9c61-e3dde2350160 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a88cd2b6-1a5a-4e4b-ba48-092ea6db25eb" returned: 0 in 0.936s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a04b29e3-724a-4e90-9c61-e3dde2350160 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "cinder-quobyte-a88cd2b6-1a5a-4e4b-ba48-092ea6db25eb" released by "delete_volume" :: held 1.917s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-a04b29e3-724a-4e90-9c61-e3dde2350160 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Created reservations ['3e10683f-c3fc-42cb-958a-4e36d5f5940e', '3be5f05a-7f4b-481d-ad00-e5babd89355f', 'bdc631ea-5540-41ed-9352-30dd50f0c5da', '6cefd93a-7919-4b86-91a4-d1aacf2ce961'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a04b29e3-724a-4e90-9c61-e3dde2350160 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a04b29e3-724a-4e90-9c61-e3dde2350160 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a04b29e3-724a-4e90-9c61-e3dde2350160 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a04b29e3-724a-4e90-9c61-e3dde2350160 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a04b29e3-724a-4e90-9c61-e3dde2350160 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a04b29e3-724a-4e90-9c61-e3dde2350160 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:28 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:48:28 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a94b90ab-53a7-4e9b-b513-025255aefbb9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "cinder-d77dea28-c841-4d1f-8a65-26b5ebc95c0d-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ba32b132-0625-4898-99d3-caba59b46a3e tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a94b90ab-53a7-4e9b-b513-025255aefbb9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "cinder-d77dea28-c841-4d1f-8a65-26b5ebc95c0d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a94b90ab-53a7-4e9b-b513-025255aefbb9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "cinder-quobyte-d77dea28-c841-4d1f-8a65-26b5ebc95c0d" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a94b90ab-53a7-4e9b-b513-025255aefbb9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "cinder-quobyte-d77dea28-c841-4d1f-8a65-26b5ebc95c0d" acquired by "delete_volume" :: waited 0.015s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:29 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f3747b-8a6e-436d-8164-f0a4ee225dc1]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a94b90ab-53a7-4e9b-b513-025255aefbb9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d77dea28-c841-4d1f-8a65-26b5ebc95c0d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:29 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d77dea28-c841-4d1f-8a65-26b5ebc95c0d Jul 06 15:48:29 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:29 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a04b29e3-724a-4e90-9c61-e3dde2350160 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.702s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:29 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-a04b29e3-724a-4e90-9c61-e3dde2350160 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:48:29 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a04b29e3-724a-4e90-9c61-e3dde2350160 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Deleted volume successfully. Jul 06 15:48:29 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908 1073741824" returned: 0 in 1.013s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a04b29e3-724a-4e90-9c61-e3dde2350160 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "cinder-a88cd2b6-1a5a-4e4b-ba48-092ea6db25eb-delete_volume" released by "delete_volume" :: held 2.849s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:29 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908 Jul 06 15:48:29 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:30 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a94b90ab-53a7-4e9b-b513-025255aefbb9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d77dea28-c841-4d1f-8a65-26b5ebc95c0d" returned: 0 in 0.796s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a94b90ab-53a7-4e9b-b513-025255aefbb9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d77dea28-c841-4d1f-8a65-26b5ebc95c0d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:30 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d77dea28-c841-4d1f-8a65-26b5ebc95c0d Jul 06 15:48:30 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:30 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908" returned: 0 in 0.683s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:48:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.587s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-504047167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7bf10b2-abbc-43e6-b8ad-e4cb41db0968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8b0711e23d241049243d47bc14e1aac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:28Z,use_quota=True,user_id='d4c04fa0d44d41758d3096bebab1c7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:48:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Creating volume e7bf10b2-abbc-43e6-b8ad-e4cb41db0968 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:48:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:48:30 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:48:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e7bf10b2-abbc-43e6-b8ad-e4cb41db0968 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f6c9a3-068c-4430-b6e6-571399b43e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a68fcca7-39ca-43bd-a9b4-f19704835908', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:30 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e7bf10b2-abbc-43e6-b8ad-e4cb41db0968 1073741824 Jul 06 15:48:30 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce9116e-9df6-4e6a-83a0-ae1c6dea404c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:30 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Volume volume-a68fcca7-39ca-43bd-a9b4-f19704835908 (a68fcca7-39ca-43bd-a9b4-f19704835908): created successfully Jul 06 15:48:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce9116e-9df6-4e6a-83a0-ae1c6dea404c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Flow 'volume_create_manager' (28525365-9213-4829-91d0-bf4388688b15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:30 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-f6f74908-b157-42ee-8717-58e8a319284c tempest-CinderUnicodeTest-592723457 None] Created volume successfully. Jul 06 15:48:30 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a94b90ab-53a7-4e9b-b513-025255aefbb9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-d77dea28-c841-4d1f-8a65-26b5ebc95c0d" returned: 0 in 0.667s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:30 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a94b90ab-53a7-4e9b-b513-025255aefbb9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "cinder-quobyte-d77dea28-c841-4d1f-8a65-26b5ebc95c0d" released by "delete_volume" :: held 1.507s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:30 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-a94b90ab-53a7-4e9b-b513-025255aefbb9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Created reservations ['6c46eac7-8a30-4bd2-8d11-e2abcf65e0ec', '17fb63af-fb4a-4ab3-8c8a-276f892c8fa3', 'd3e88724-284f-401b-b1f6-832fc05e6204', 'eb40c52d-720d-4522-9fdc-87b0387255b0'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a94b90ab-53a7-4e9b-b513-025255aefbb9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a94b90ab-53a7-4e9b-b513-025255aefbb9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a94b90ab-53a7-4e9b-b513-025255aefbb9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a94b90ab-53a7-4e9b-b513-025255aefbb9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a94b90ab-53a7-4e9b-b513-025255aefbb9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a94b90ab-53a7-4e9b-b513-025255aefbb9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:31 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:48:31 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:31 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e7bf10b2-abbc-43e6-b8ad-e4cb41db0968 1073741824" returned: 0 in 0.874s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e7bf10b2-abbc-43e6-b8ad-e4cb41db0968 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:31 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e7bf10b2-abbc-43e6-b8ad-e4cb41db0968 Jul 06 15:48:31 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-33cbe65f-0af6-4a5b-879a-76fad4c8c421 tempest-CinderUnicodeTest-592723457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:31 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ebdd463a-0414-4afd-b9aa-69943ae68e7d tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "cinder-91825226-8576-49bb-aa70-3df51244ab68-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:31 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ebdd463a-0414-4afd-b9aa-69943ae68e7d tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "cinder-91825226-8576-49bb-aa70-3df51244ab68-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:31 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ebdd463a-0414-4afd-b9aa-69943ae68e7d tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "cinder-quobyte-91825226-8576-49bb-aa70-3df51244ab68" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:31 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ebdd463a-0414-4afd-b9aa-69943ae68e7d tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "cinder-quobyte-91825226-8576-49bb-aa70-3df51244ab68" acquired by "delete_volume" :: waited 0.019s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:31 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[81147fc4-1eb5-4d2b-98a9-38f295ac5734]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ebdd463a-0414-4afd-b9aa-69943ae68e7d tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-91825226-8576-49bb-aa70-3df51244ab68 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:31 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a94b90ab-53a7-4e9b-b513-025255aefbb9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.737s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:31 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-a94b90ab-53a7-4e9b-b513-025255aefbb9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:48:31 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a94b90ab-53a7-4e9b-b513-025255aefbb9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Deleted volume successfully. Jul 06 15:48:31 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a94b90ab-53a7-4e9b-b513-025255aefbb9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "cinder-d77dea28-c841-4d1f-8a65-26b5ebc95c0d-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:31 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-91825226-8576-49bb-aa70-3df51244ab68 Jul 06 15:48:31 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:31 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e7bf10b2-abbc-43e6-b8ad-e4cb41db0968" returned: 0 in 0.767s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:31 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:48:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ba32b132-0625-4898-99d3-caba59b46a3e tempest-ProjectMemberTests-765095290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.711s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a8f3f4-c234-4943-9b08-132ff1bdb8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7bf10b2-abbc-43e6-b8ad-e4cb41db0968', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38100bd0-5c43-41a0-b28c-52b76e80338b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:32 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-ba32b132-0625-4898-99d3-caba59b46a3e tempest-ProjectMemberTests-765095290 None] Creating offline snapshot be2a3407-0d3b-4c04-a3eb-db35f0bdba78 of volume df61febf-9da1-4adb-8302-a9db4b0be4a4 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:48:32 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Volume volume-e7bf10b2-abbc-43e6-b8ad-e4cb41db0968 (e7bf10b2-abbc-43e6-b8ad-e4cb41db0968): created successfully Jul 06 15:48:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38100bd0-5c43-41a0-b28c-52b76e80338b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Flow 'volume_create_manager' (d0e39f28-32a4-4875-ab23-130675557076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:32 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[974da3cd-e18c-476a-9fb7-dc351b8b291e]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ba32b132-0625-4898-99d3-caba59b46a3e tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:32 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-5b6593c7-b37d-46ae-8e57-7b34ded3f24f tempest-ProjectReaderTests-1147876465 None] Created volume successfully. Jul 06 15:48:32 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4 Jul 06 15:48:32 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:32 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ebdd463a-0414-4afd-b9aa-69943ae68e7d tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-91825226-8576-49bb-aa70-3df51244ab68" returned: 0 in 0.770s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ebdd463a-0414-4afd-b9aa-69943ae68e7d tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-91825226-8576-49bb-aa70-3df51244ab68 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:32 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-91825226-8576-49bb-aa70-3df51244ab68 Jul 06 15:48:32 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8ad315e8-eb1f-4698-b0f5-2b64f8f9dfbc tempest-ProjectReaderTests-1147876465 None] Acquiring lock "cinder-e7bf10b2-abbc-43e6-b8ad-e4cb41db0968-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8ad315e8-eb1f-4698-b0f5-2b64f8f9dfbc tempest-ProjectReaderTests-1147876465 None] Lock "cinder-e7bf10b2-abbc-43e6-b8ad-e4cb41db0968-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8ad315e8-eb1f-4698-b0f5-2b64f8f9dfbc tempest-ProjectReaderTests-1147876465 None] Acquiring lock "cinder-quobyte-e7bf10b2-abbc-43e6-b8ad-e4cb41db0968" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8ad315e8-eb1f-4698-b0f5-2b64f8f9dfbc tempest-ProjectReaderTests-1147876465 None] Lock "cinder-quobyte-e7bf10b2-abbc-43e6-b8ad-e4cb41db0968" acquired by "delete_volume" :: waited 0.019s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:32 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[c301b175-5b1e-400a-8fe5-fcee2f604fc8]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8ad315e8-eb1f-4698-b0f5-2b64f8f9dfbc tempest-ProjectReaderTests-1147876465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e7bf10b2-abbc-43e6-b8ad-e4cb41db0968 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:32 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e7bf10b2-abbc-43e6-b8ad-e4cb41db0968 Jul 06 15:48:32 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:32 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ba32b132-0625-4898-99d3-caba59b46a3e tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4" returned: 0 in 0.826s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ba32b132-0625-4898-99d3-caba59b46a3e tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4.be2a3407-0d3b-4c04-a3eb-db35f0bdba78 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:32 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4.be2a3407-0d3b-4c04-a3eb-db35f0bdba78 1G Jul 06 15:48:32 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:33 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ebdd463a-0414-4afd-b9aa-69943ae68e7d tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-91825226-8576-49bb-aa70-3df51244ab68" returned: 0 in 0.697s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:33 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ebdd463a-0414-4afd-b9aa-69943ae68e7d tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "cinder-quobyte-91825226-8576-49bb-aa70-3df51244ab68" released by "delete_volume" :: held 1.512s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:33 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-ebdd463a-0414-4afd-b9aa-69943ae68e7d tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Created reservations ['a3b0d5a6-276a-4784-9cc4-de3a52f0d104', '8efea358-dce8-48f2-b9d5-140aeb78041a', '78bc6971-e6ed-485f-911d-2407eaf0e674', '853ab066-b15d-427a-844f-f30d2b3642b9'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ebdd463a-0414-4afd-b9aa-69943ae68e7d tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ebdd463a-0414-4afd-b9aa-69943ae68e7d tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ebdd463a-0414-4afd-b9aa-69943ae68e7d tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:33 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-ebdd463a-0414-4afd-b9aa-69943ae68e7d tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ebdd463a-0414-4afd-b9aa-69943ae68e7d tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ebdd463a-0414-4afd-b9aa-69943ae68e7d tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:33 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:48:33 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:33 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8ad315e8-eb1f-4698-b0f5-2b64f8f9dfbc tempest-ProjectReaderTests-1147876465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e7bf10b2-abbc-43e6-b8ad-e4cb41db0968" returned: 0 in 0.854s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8ad315e8-eb1f-4698-b0f5-2b64f8f9dfbc tempest-ProjectReaderTests-1147876465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e7bf10b2-abbc-43e6-b8ad-e4cb41db0968 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:33 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e7bf10b2-abbc-43e6-b8ad-e4cb41db0968 Jul 06 15:48:33 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:33 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ba32b132-0625-4898-99d3-caba59b46a3e tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4.be2a3407-0d3b-4c04-a3eb-db35f0bdba78 1G" returned: 0 in 0.886s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ba32b132-0625-4898-99d3-caba59b46a3e tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df61febf-9da1-4adb-8302-a9db4b0be4a4 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4.be2a3407-0d3b-4c04-a3eb-db35f0bdba78 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:33 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df61febf-9da1-4adb-8302-a9db4b0be4a4 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4.be2a3407-0d3b-4c04-a3eb-db35f0bdba78 Jul 06 15:48:33 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:33 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-acf3cd11-15c4-4527-bdc3-555448cd5cc9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "cinder-25794182-2ca0-4eef-8bb2-4d4e9aeb0158-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:33 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-acf3cd11-15c4-4527-bdc3-555448cd5cc9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "cinder-25794182-2ca0-4eef-8bb2-4d4e9aeb0158-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:33 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-acf3cd11-15c4-4527-bdc3-555448cd5cc9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "cinder-quobyte-25794182-2ca0-4eef-8bb2-4d4e9aeb0158" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:33 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-acf3cd11-15c4-4527-bdc3-555448cd5cc9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "cinder-quobyte-25794182-2ca0-4eef-8bb2-4d4e9aeb0158" acquired by "delete_volume" :: waited 0.019s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:33 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a158a1c-5a07-42ea-a7f8-17bf352c70ef]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-acf3cd11-15c4-4527-bdc3-555448cd5cc9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-25794182-2ca0-4eef-8bb2-4d4e9aeb0158 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:34 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ebdd463a-0414-4afd-b9aa-69943ae68e7d tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.758s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:34 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-ebdd463a-0414-4afd-b9aa-69943ae68e7d tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:48:34 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-ebdd463a-0414-4afd-b9aa-69943ae68e7d tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Deleted volume successfully. Jul 06 15:48:34 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-25794182-2ca0-4eef-8bb2-4d4e9aeb0158 Jul 06 15:48:34 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-ebdd463a-0414-4afd-b9aa-69943ae68e7d tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "cinder-91825226-8576-49bb-aa70-3df51244ab68-delete_volume" released by "delete_volume" :: held 2.507s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:34 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:34 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8ad315e8-eb1f-4698-b0f5-2b64f8f9dfbc tempest-ProjectReaderTests-1147876465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-e7bf10b2-abbc-43e6-b8ad-e4cb41db0968" returned: 0 in 0.726s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:34 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8ad315e8-eb1f-4698-b0f5-2b64f8f9dfbc tempest-ProjectReaderTests-1147876465 None] Lock "cinder-quobyte-e7bf10b2-abbc-43e6-b8ad-e4cb41db0968" released by "delete_volume" :: held 1.635s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:34 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-8ad315e8-eb1f-4698-b0f5-2b64f8f9dfbc tempest-ProjectReaderTests-1147876465 None] Created reservations ['a729f4ed-ca0f-4065-8886-a5adae01a0ba', '0d62565b-14e3-4419-8d2a-fd180ecdc393', 'f27e325d-8dfa-4980-a8c2-774aa97d80ac', '20fcdf22-5565-4b62-867d-c3c14fc8141e'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8ad315e8-eb1f-4698-b0f5-2b64f8f9dfbc tempest-ProjectReaderTests-1147876465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8ad315e8-eb1f-4698-b0f5-2b64f8f9dfbc tempest-ProjectReaderTests-1147876465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-8ad315e8-eb1f-4698-b0f5-2b64f8f9dfbc tempest-ProjectReaderTests-1147876465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:34 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-8ad315e8-eb1f-4698-b0f5-2b64f8f9dfbc tempest-ProjectReaderTests-1147876465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8ad315e8-eb1f-4698-b0f5-2b64f8f9dfbc tempest-ProjectReaderTests-1147876465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8ad315e8-eb1f-4698-b0f5-2b64f8f9dfbc tempest-ProjectReaderTests-1147876465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:34 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:48:34 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:34 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ba32b132-0625-4898-99d3-caba59b46a3e tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df61febf-9da1-4adb-8302-a9db4b0be4a4 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4.be2a3407-0d3b-4c04-a3eb-db35f0bdba78" returned: 0 in 0.811s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:34 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-ba32b132-0625-4898-99d3-caba59b46a3e tempest-ProjectMemberTests-765095290 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4.be2a3407-0d3b-4c04-a3eb-db35f0bdba78 is being set with open permissions: ugo+rw Jul 06 15:48:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ba32b132-0625-4898-99d3-caba59b46a3e tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4.be2a3407-0d3b-4c04-a3eb-db35f0bdba78 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:34 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4.be2a3407-0d3b-4c04-a3eb-db35f0bdba78 Jul 06 15:48:34 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:34 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-acf3cd11-15c4-4527-bdc3-555448cd5cc9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-25794182-2ca0-4eef-8bb2-4d4e9aeb0158" returned: 0 in 0.865s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-acf3cd11-15c4-4527-bdc3-555448cd5cc9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-25794182-2ca0-4eef-8bb2-4d4e9aeb0158 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:34 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-25794182-2ca0-4eef-8bb2-4d4e9aeb0158 Jul 06 15:48:34 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:35 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8ad315e8-eb1f-4698-b0f5-2b64f8f9dfbc tempest-ProjectReaderTests-1147876465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.811s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:35 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-8ad315e8-eb1f-4698-b0f5-2b64f8f9dfbc tempest-ProjectReaderTests-1147876465 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:48:35 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-8ad315e8-eb1f-4698-b0f5-2b64f8f9dfbc tempest-ProjectReaderTests-1147876465 None] Deleted volume successfully. Jul 06 15:48:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8ad315e8-eb1f-4698-b0f5-2b64f8f9dfbc tempest-ProjectReaderTests-1147876465 None] Lock "cinder-e7bf10b2-abbc-43e6-b8ad-e4cb41db0968-delete_volume" released by "delete_volume" :: held 2.697s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:35 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:48:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Flow 'volume_create_manager' (6d15ba61-02a8-44a5-ae0e-88229b32379f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df76786-6744-48fb-b9dd-a0e0303e16d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df76786-6744-48fb-b9dd-a0e0303e16d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1176298295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f99c93-ff32-48c1-9bec-7f0cd48f9096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8b0711e23d241049243d47bc14e1aac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:35Z,use_quota=True,user_id='d4c04fa0d44d41758d3096bebab1c7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d71a91fa-f6d8-4b5e-8529-3ff055de44c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d71a91fa-f6d8-4b5e-8529-3ff055de44c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (706a3ef5-d6d5-4982-8d46-0c7f95cf7575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (706a3ef5-d6d5-4982-8d46-0c7f95cf7575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08f99c93-ff32-48c1-9bec-7f0cd48f9096', 'volume_name': 'volume-08f99c93-ff32-48c1-9bec-7f0cd48f9096', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d1b875-ae68-4097-8ca5-af85cc369357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d1b875-ae68-4097-8ca5-af85cc369357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:35 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ace8533-39d1-42ad-9803-2567c2eb7ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:35 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Volume 08f99c93-ff32-48c1-9bec-7f0cd48f9096: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08f99c93-ff32-48c1-9bec-7f0cd48f9096', 'volume_size': 1} Jul 06 15:48:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:35 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ba32b132-0625-4898-99d3-caba59b46a3e tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4.be2a3407-0d3b-4c04-a3eb-db35f0bdba78" returned: 0 in 0.809s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ba32b132-0625-4898-99d3-caba59b46a3e tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:35 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4.info Jul 06 15:48:35 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:35 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-acf3cd11-15c4-4527-bdc3-555448cd5cc9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-25794182-2ca0-4eef-8bb2-4d4e9aeb0158" returned: 0 in 0.844s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-acf3cd11-15c4-4527-bdc3-555448cd5cc9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "cinder-quobyte-25794182-2ca0-4eef-8bb2-4d4e9aeb0158" released by "delete_volume" :: held 1.771s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:35 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-acf3cd11-15c4-4527-bdc3-555448cd5cc9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Created reservations ['b8c5ead1-b85b-4ddc-87f6-a9ad584f16da', 'f21fa97d-4374-4820-854c-372598a95bf4', 'f2be1c6f-d121-47b9-ac83-eda6de48d38e', '1df97b0c-7986-4fbe-950d-96f0484769e7'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-acf3cd11-15c4-4527-bdc3-555448cd5cc9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-acf3cd11-15c4-4527-bdc3-555448cd5cc9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:35 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-acf3cd11-15c4-4527-bdc3-555448cd5cc9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:35 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-acf3cd11-15c4-4527-bdc3-555448cd5cc9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-acf3cd11-15c4-4527-bdc3-555448cd5cc9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-acf3cd11-15c4-4527-bdc3-555448cd5cc9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:35 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:48:35 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:36 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ba32b132-0625-4898-99d3-caba59b46a3e tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4.info" returned: 0 in 0.678s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:36 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-ba32b132-0625-4898-99d3-caba59b46a3e tempest-ProjectMemberTests-765095290 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4.info is being set with open permissions: ugo+rw Jul 06 15:48:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ba32b132-0625-4898-99d3-caba59b46a3e tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:36 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4.info Jul 06 15:48:36 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1ef3f8b5-533f-4d43-9ce6-6530cf0c967f tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "cinder-00be9789-7540-495a-81f1-9b0c6d1335d5-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1ef3f8b5-533f-4d43-9ce6-6530cf0c967f tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "cinder-00be9789-7540-495a-81f1-9b0c6d1335d5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1ef3f8b5-533f-4d43-9ce6-6530cf0c967f tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "cinder-quobyte-00be9789-7540-495a-81f1-9b0c6d1335d5" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1ef3f8b5-533f-4d43-9ce6-6530cf0c967f tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "cinder-quobyte-00be9789-7540-495a-81f1-9b0c6d1335d5" acquired by "delete_volume" :: waited 0.031s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:36 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[410be0d2-dd3e-48b0-b58a-2166a852d5f2]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1ef3f8b5-533f-4d43-9ce6-6530cf0c967f tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-00be9789-7540-495a-81f1-9b0c6d1335d5 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:36 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-00be9789-7540-495a-81f1-9b0c6d1335d5 Jul 06 15:48:36 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:36 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-acf3cd11-15c4-4527-bdc3-555448cd5cc9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.719s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:36 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-acf3cd11-15c4-4527-bdc3-555448cd5cc9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:48:36 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-acf3cd11-15c4-4527-bdc3-555448cd5cc9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Deleted volume successfully. Jul 06 15:48:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-acf3cd11-15c4-4527-bdc3-555448cd5cc9 tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "cinder-25794182-2ca0-4eef-8bb2-4d4e9aeb0158-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:36 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-ba32b132-0625-4898-99d3-caba59b46a3e tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4.info" returned: 0 in 0.701s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-ba32b132-0625-4898-99d3-caba59b46a3e tempest-ProjectMemberTests-765095290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.823s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-33cbe65f-0af6-4a5b-879a-76fad4c8c421 tempest-CinderUnicodeTest-592723457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.256s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:36 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-33cbe65f-0af6-4a5b-879a-76fad4c8c421 tempest-CinderUnicodeTest-592723457 None] Creating offline snapshot 32e35adb-eb1e-45c3-8c74-b4f01a6357d1 of volume a68fcca7-39ca-43bd-a9b4-f19704835908 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:48:36 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2e4354-9fd4-4fab-b55b-d6c74935041d]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-33cbe65f-0af6-4a5b-879a-76fad4c8c421 tempest-CinderUnicodeTest-592723457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:36 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-ba32b132-0625-4898-99d3-caba59b46a3e tempest-ProjectMemberTests-765095290 None] Create snapshot completed successfully Jul 06 15:48:36 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908 Jul 06 15:48:36 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:37 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1ef3f8b5-533f-4d43-9ce6-6530cf0c967f tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-00be9789-7540-495a-81f1-9b0c6d1335d5" returned: 0 in 0.799s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1ef3f8b5-533f-4d43-9ce6-6530cf0c967f tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-00be9789-7540-495a-81f1-9b0c6d1335d5 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:37 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-00be9789-7540-495a-81f1-9b0c6d1335d5 Jul 06 15:48:37 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:37 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-bf6c02f7-9c5a-48fb-9de2-5655488577a0 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-be2a3407-0d3b-4c04-a3eb-db35f0bdba78-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:37 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-bf6c02f7-9c5a-48fb-9de2-5655488577a0 tempest-ProjectMemberTests-765095290 None] Lock "cinder-be2a3407-0d3b-4c04-a3eb-db35f0bdba78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:37 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-bf6c02f7-9c5a-48fb-9de2-5655488577a0 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-quobyte-df61febf-9da1-4adb-8302-a9db4b0be4a4" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:37 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-bf6c02f7-9c5a-48fb-9de2-5655488577a0 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-df61febf-9da1-4adb-8302-a9db4b0be4a4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:37 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-bf6c02f7-9c5a-48fb-9de2-5655488577a0 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-quobyte-be2a3407-0d3b-4c04-a3eb-db35f0bdba78" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:37 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-33cbe65f-0af6-4a5b-879a-76fad4c8c421 tempest-CinderUnicodeTest-592723457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908" returned: 0 in 0.871s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-33cbe65f-0af6-4a5b-879a-76fad4c8c421 tempest-CinderUnicodeTest-592723457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908.32e35adb-eb1e-45c3-8c74-b4f01a6357d1 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:37 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-bf6c02f7-9c5a-48fb-9de2-5655488577a0 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-be2a3407-0d3b-4c04-a3eb-db35f0bdba78" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-bf6c02f7-9c5a-48fb-9de2-5655488577a0 tempest-ProjectMemberTests-765095290 None] Deleting offline snapshot be2a3407-0d3b-4c04-a3eb-db35f0bdba78 of volume df61febf-9da1-4adb-8302-a9db4b0be4a4 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:48:37 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908.32e35adb-eb1e-45c3-8c74-b4f01a6357d1 1G Jul 06 15:48:37 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-bf6c02f7-9c5a-48fb-9de2-5655488577a0 tempest-ProjectMemberTests-765095290 None] snapshot_file for this snap is: volume-df61febf-9da1-4adb-8302-a9db4b0be4a4.be2a3407-0d3b-4c04-a3eb-db35f0bdba78 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:48:37 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1ef3f8b5-533f-4d43-9ce6-6530cf0c967f tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-00be9789-7540-495a-81f1-9b0c6d1335d5" returned: 0 in 0.671s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:37 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f62b4f3-1359-4fc3-8b13-07722d959108]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bf6c02f7-9c5a-48fb-9de2-5655488577a0 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4.be2a3407-0d3b-4c04-a3eb-db35f0bdba78 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:37 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1ef3f8b5-533f-4d43-9ce6-6530cf0c967f tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "cinder-quobyte-00be9789-7540-495a-81f1-9b0c6d1335d5" released by "delete_volume" :: held 1.522s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:37 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-1ef3f8b5-533f-4d43-9ce6-6530cf0c967f tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Created reservations ['999d360c-4fab-4f10-8188-58fdffe57e0d', '963c1184-37be-4b43-9e16-1bcae9c24099', '27fc9132-726a-4535-9d61-67ac623ae876', '0baac679-f06e-43e8-b492-4618df83afda'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:37 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4.be2a3407-0d3b-4c04-a3eb-db35f0bdba78 Jul 06 15:48:37 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1ef3f8b5-533f-4d43-9ce6-6530cf0c967f tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1ef3f8b5-533f-4d43-9ce6-6530cf0c967f tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1ef3f8b5-533f-4d43-9ce6-6530cf0c967f tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-1ef3f8b5-533f-4d43-9ce6-6530cf0c967f tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1ef3f8b5-533f-4d43-9ce6-6530cf0c967f tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1ef3f8b5-533f-4d43-9ce6-6530cf0c967f tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:37 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:48:37 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:48:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:38 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:48:38 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:38 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bf6c02f7-9c5a-48fb-9de2-5655488577a0 tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4.be2a3407-0d3b-4c04-a3eb-db35f0bdba78" returned: 0 in 0.810s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-bf6c02f7-9c5a-48fb-9de2-5655488577a0 tempest-ProjectMemberTests-765095290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df61febf-9da1-4adb-8302-a9db4b0be4a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:48:38 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:38 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[517e41d8-a0ff-45db-a515-f99dbf9fb9fc]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bf6c02f7-9c5a-48fb-9de2-5655488577a0 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1ef3f8b5-533f-4d43-9ce6-6530cf0c967f tempest-CreateVolumesFromSourceVolumeTest-949904077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.719s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:38 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-1ef3f8b5-533f-4d43-9ce6-6530cf0c967f tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:48:38 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-1ef3f8b5-533f-4d43-9ce6-6530cf0c967f tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Deleted volume successfully. Jul 06 15:48:38 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-33cbe65f-0af6-4a5b-879a-76fad4c8c421 tempest-CinderUnicodeTest-592723457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908.32e35adb-eb1e-45c3-8c74-b4f01a6357d1 1G" returned: 0 in 0.984s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-33cbe65f-0af6-4a5b-879a-76fad4c8c421 tempest-CinderUnicodeTest-592723457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a68fcca7-39ca-43bd-a9b4-f19704835908 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908.32e35adb-eb1e-45c3-8c74-b4f01a6357d1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-1ef3f8b5-533f-4d43-9ce6-6530cf0c967f tempest-CreateVolumesFromSourceVolumeTest-949904077 None] Lock "cinder-00be9789-7540-495a-81f1-9b0c6d1335d5-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:38 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a68fcca7-39ca-43bd-a9b4-f19704835908 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908.32e35adb-eb1e-45c3-8c74-b4f01a6357d1 Jul 06 15:48:38 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:38 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4 Jul 06 15:48:38 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:39 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.952s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:48:39 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager._thread_info {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:48:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread count: 28 {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:48:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread info: [<_MainThread(MainThread, started 124857273856128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:48:39 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-33cbe65f-0af6-4a5b-879a-76fad4c8c421 tempest-CinderUnicodeTest-592723457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a68fcca7-39ca-43bd-a9b4-f19704835908 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908.32e35adb-eb1e-45c3-8c74-b4f01a6357d1" returned: 0 in 0.841s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:39 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-33cbe65f-0af6-4a5b-879a-76fad4c8c421 tempest-CinderUnicodeTest-592723457 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908.32e35adb-eb1e-45c3-8c74-b4f01a6357d1 is being set with open permissions: ugo+rw Jul 06 15:48:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-33cbe65f-0af6-4a5b-879a-76fad4c8c421 tempest-CinderUnicodeTest-592723457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908.32e35adb-eb1e-45c3-8c74-b4f01a6357d1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:39 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bf6c02f7-9c5a-48fb-9de2-5655488577a0 tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4" returned: 0 in 0.928s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bf6c02f7-9c5a-48fb-9de2-5655488577a0 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4.be2a3407-0d3b-4c04-a3eb-db35f0bdba78 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:39 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908.32e35adb-eb1e-45c3-8c74-b4f01a6357d1 Jul 06 15:48:39 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:39 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4.be2a3407-0d3b-4c04-a3eb-db35f0bdba78 Jul 06 15:48:39 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:40 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-33cbe65f-0af6-4a5b-879a-76fad4c8c421 tempest-CinderUnicodeTest-592723457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908.32e35adb-eb1e-45c3-8c74-b4f01a6357d1" returned: 0 in 0.787s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-33cbe65f-0af6-4a5b-879a-76fad4c8c421 tempest-CinderUnicodeTest-592723457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:40 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908.info Jul 06 15:48:40 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:40 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bf6c02f7-9c5a-48fb-9de2-5655488577a0 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4.be2a3407-0d3b-4c04-a3eb-db35f0bdba78" returned: 0 in 0.878s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bf6c02f7-9c5a-48fb-9de2-5655488577a0 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4.be2a3407-0d3b-4c04-a3eb-db35f0bdba78 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:40 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4.be2a3407-0d3b-4c04-a3eb-db35f0bdba78 Jul 06 15:48:40 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:41 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-33cbe65f-0af6-4a5b-879a-76fad4c8c421 tempest-CinderUnicodeTest-592723457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908.info" returned: 0 in 0.726s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:41 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-33cbe65f-0af6-4a5b-879a-76fad4c8c421 tempest-CinderUnicodeTest-592723457 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908.info is being set with open permissions: ugo+rw Jul 06 15:48:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-33cbe65f-0af6-4a5b-879a-76fad4c8c421 tempest-CinderUnicodeTest-592723457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:41 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908.info Jul 06 15:48:41 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:41 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-bf6c02f7-9c5a-48fb-9de2-5655488577a0 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4.be2a3407-0d3b-4c04-a3eb-db35f0bdba78" returned: 0 in 0.714s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-bf6c02f7-9c5a-48fb-9de2-5655488577a0 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-be2a3407-0d3b-4c04-a3eb-db35f0bdba78" released by "_delete_snapshot" :: held 3.475s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-bf6c02f7-9c5a-48fb-9de2-5655488577a0 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-df61febf-9da1-4adb-8302-a9db4b0be4a4" released by "delete_snapshot" :: held 3.517s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:41 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-bf6c02f7-9c5a-48fb-9de2-5655488577a0 tempest-ProjectMemberTests-765095290 None] Created reservations ['9c866d2e-f7b4-4839-87ce-42ce28ea97cf', 'c3446064-5b0b-46b8-a904-9673795e6b9a', 'dce2c728-29d4-43b3-af8f-a95e2d38b5ef', '36432b63-82e6-445c-a822-cf8b285c2197'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:41 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-bf6c02f7-9c5a-48fb-9de2-5655488577a0 tempest-ProjectMemberTests-765095290 None] Delete snapshot completed successfully. Jul 06 15:48:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-bf6c02f7-9c5a-48fb-9de2-5655488577a0 tempest-ProjectMemberTests-765095290 None] Lock "cinder-be2a3407-0d3b-4c04-a3eb-db35f0bdba78-delete_snapshot" released by "delete_snapshot" :: held 3.682s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:41 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-33cbe65f-0af6-4a5b-879a-76fad4c8c421 tempest-CinderUnicodeTest-592723457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908.info" returned: 0 in 0.696s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-33cbe65f-0af6-4a5b-879a-76fad4c8c421 tempest-CinderUnicodeTest-592723457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.457s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:41 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1176298295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f99c93-ff32-48c1-9bec-7f0cd48f9096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8b0711e23d241049243d47bc14e1aac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:35Z,use_quota=True,user_id='d4c04fa0d44d41758d3096bebab1c7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:48:41 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Creating volume 08f99c93-ff32-48c1-9bec-7f0cd48f9096 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:48:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:41 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:41 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:41 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:48:41 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:48:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-08f99c93-ff32-48c1-9bec-7f0cd48f9096 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:41 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-08f99c93-ff32-48c1-9bec-7f0cd48f9096 1073741824 Jul 06 15:48:41 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:41 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-33cbe65f-0af6-4a5b-879a-76fad4c8c421 tempest-CinderUnicodeTest-592723457 None] Create snapshot completed successfully Jul 06 15:48:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4a30eea7-d5bc-46b2-9aa5-2ab138a02cb2 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-df61febf-9da1-4adb-8302-a9db4b0be4a4-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4a30eea7-d5bc-46b2-9aa5-2ab138a02cb2 tempest-ProjectMemberTests-765095290 None] Lock "cinder-df61febf-9da1-4adb-8302-a9db4b0be4a4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:42 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4a30eea7-d5bc-46b2-9aa5-2ab138a02cb2 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-quobyte-df61febf-9da1-4adb-8302-a9db4b0be4a4" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:42 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4a30eea7-d5bc-46b2-9aa5-2ab138a02cb2 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-df61febf-9da1-4adb-8302-a9db4b0be4a4" acquired by "delete_volume" :: waited 0.017s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:42 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed859aff-f8c5-4fa1-8d79-24577dfcce94]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4a30eea7-d5bc-46b2-9aa5-2ab138a02cb2 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:42 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-91478d25-495b-4d77-9754-e8128fa30e38 tempest-CinderUnicodeTest-592723457 None] Acquiring lock "cinder-32e35adb-eb1e-45c3-8c74-b4f01a6357d1-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:42 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-91478d25-495b-4d77-9754-e8128fa30e38 tempest-CinderUnicodeTest-592723457 None] Lock "cinder-32e35adb-eb1e-45c3-8c74-b4f01a6357d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:42 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-91478d25-495b-4d77-9754-e8128fa30e38 tempest-CinderUnicodeTest-592723457 None] Acquiring lock "cinder-quobyte-a68fcca7-39ca-43bd-a9b4-f19704835908" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:42 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-91478d25-495b-4d77-9754-e8128fa30e38 tempest-CinderUnicodeTest-592723457 None] Lock "cinder-quobyte-a68fcca7-39ca-43bd-a9b4-f19704835908" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:42 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-91478d25-495b-4d77-9754-e8128fa30e38 tempest-CinderUnicodeTest-592723457 None] Acquiring lock "cinder-quobyte-32e35adb-eb1e-45c3-8c74-b4f01a6357d1" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:42 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-91478d25-495b-4d77-9754-e8128fa30e38 tempest-CinderUnicodeTest-592723457 None] Lock "cinder-quobyte-32e35adb-eb1e-45c3-8c74-b4f01a6357d1" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:42 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-91478d25-495b-4d77-9754-e8128fa30e38 tempest-CinderUnicodeTest-592723457 None] Deleting offline snapshot 32e35adb-eb1e-45c3-8c74-b4f01a6357d1 of volume a68fcca7-39ca-43bd-a9b4-f19704835908 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:48:42 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-91478d25-495b-4d77-9754-e8128fa30e38 tempest-CinderUnicodeTest-592723457 None] snapshot_file for this snap is: volume-a68fcca7-39ca-43bd-a9b4-f19704835908.32e35adb-eb1e-45c3-8c74-b4f01a6357d1 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:48:42 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b611d3-2134-4157-8c0f-c35f38d8dd0f]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-91478d25-495b-4d77-9754-e8128fa30e38 tempest-CinderUnicodeTest-592723457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908.32e35adb-eb1e-45c3-8c74-b4f01a6357d1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:42 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4 Jul 06 15:48:42 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:42 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908.32e35adb-eb1e-45c3-8c74-b4f01a6357d1 Jul 06 15:48:42 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:42 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-08f99c93-ff32-48c1-9bec-7f0cd48f9096 1073741824" returned: 0 in 0.955s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-08f99c93-ff32-48c1-9bec-7f0cd48f9096 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:42 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-08f99c93-ff32-48c1-9bec-7f0cd48f9096 Jul 06 15:48:42 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:43 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4a30eea7-d5bc-46b2-9aa5-2ab138a02cb2 tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4" returned: 0 in 0.923s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4a30eea7-d5bc-46b2-9aa5-2ab138a02cb2 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:43 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:43 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4 Jul 06 15:48:43 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-91478d25-495b-4d77-9754-e8128fa30e38 tempest-CinderUnicodeTest-592723457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908.32e35adb-eb1e-45c3-8c74-b4f01a6357d1" returned: 0 in 0.810s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:43 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-91478d25-495b-4d77-9754-e8128fa30e38 tempest-CinderUnicodeTest-592723457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a68fcca7-39ca-43bd-a9b4-f19704835908(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:48:43 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b50eea8-a9cd-4559-a004-858102d07faf]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-91478d25-495b-4d77-9754-e8128fa30e38 tempest-CinderUnicodeTest-592723457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:43 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908 Jul 06 15:48:43 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:43 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-08f99c93-ff32-48c1-9bec-7f0cd48f9096" returned: 0 in 0.830s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:43 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:48:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ace8533-39d1-42ad-9803-2567c2eb7ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08f99c93-ff32-48c1-9bec-7f0cd48f9096', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664c20b7-c9a0-4f3a-bfd7-175fa90d2e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:43 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Volume volume-08f99c93-ff32-48c1-9bec-7f0cd48f9096 (08f99c93-ff32-48c1-9bec-7f0cd48f9096): created successfully Jul 06 15:48:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664c20b7-c9a0-4f3a-bfd7-175fa90d2e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:43 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Flow 'volume_create_manager' (6d15ba61-02a8-44a5-ae0e-88229b32379f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:43 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-fd484ffb-9383-489b-8a99-d7bc27e70d5c tempest-ProjectReaderTests-1147876465 None] Created volume successfully. Jul 06 15:48:43 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4a30eea7-d5bc-46b2-9aa5-2ab138a02cb2 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-df61febf-9da1-4adb-8302-a9db4b0be4a4" returned: 0 in 0.842s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4a30eea7-d5bc-46b2-9aa5-2ab138a02cb2 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-df61febf-9da1-4adb-8302-a9db4b0be4a4" released by "delete_volume" :: held 1.860s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:43 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-4a30eea7-d5bc-46b2-9aa5-2ab138a02cb2 tempest-ProjectMemberTests-765095290 None] Created reservations ['56b42b8d-849e-4795-81d3-cc59cbc6f20b', '24c8b651-b926-4484-8b8e-854555ef58a1', 'f9491096-db7c-40bb-9dbd-9e2d8f073886', 'ca07e505-3852-4be6-a120-2a544813bde4'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:43 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e6713e6a-4b04-40e8-8e29-4933c883be3e tempest-ProjectReaderTests-1147876465 None] Acquiring lock "cinder-08f99c93-ff32-48c1-9bec-7f0cd48f9096-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:44 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-91478d25-495b-4d77-9754-e8128fa30e38 tempest-CinderUnicodeTest-592723457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908" returned: 0 in 0.891s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-91478d25-495b-4d77-9754-e8128fa30e38 tempest-CinderUnicodeTest-592723457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908.32e35adb-eb1e-45c3-8c74-b4f01a6357d1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e6713e6a-4b04-40e8-8e29-4933c883be3e tempest-ProjectReaderTests-1147876465 None] Lock "cinder-08f99c93-ff32-48c1-9bec-7f0cd48f9096-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:44 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908.32e35adb-eb1e-45c3-8c74-b4f01a6357d1 Jul 06 15:48:44 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e6713e6a-4b04-40e8-8e29-4933c883be3e tempest-ProjectReaderTests-1147876465 None] Acquiring lock "cinder-quobyte-08f99c93-ff32-48c1-9bec-7f0cd48f9096" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4a30eea7-d5bc-46b2-9aa5-2ab138a02cb2 tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4a30eea7-d5bc-46b2-9aa5-2ab138a02cb2 tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4a30eea7-d5bc-46b2-9aa5-2ab138a02cb2 tempest-ProjectMemberTests-765095290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4a30eea7-d5bc-46b2-9aa5-2ab138a02cb2 tempest-ProjectMemberTests-765095290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4a30eea7-d5bc-46b2-9aa5-2ab138a02cb2 tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4a30eea7-d5bc-46b2-9aa5-2ab138a02cb2 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e6713e6a-4b04-40e8-8e29-4933c883be3e tempest-ProjectReaderTests-1147876465 None] Lock "cinder-quobyte-08f99c93-ff32-48c1-9bec-7f0cd48f9096" acquired by "delete_volume" :: waited 0.046s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:44 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:48:44 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:44 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[37407af0-4733-44c8-96b7-f7d28dc839ff]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e6713e6a-4b04-40e8-8e29-4933c883be3e tempest-ProjectReaderTests-1147876465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-08f99c93-ff32-48c1-9bec-7f0cd48f9096 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:44 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-08f99c93-ff32-48c1-9bec-7f0cd48f9096 Jul 06 15:48:44 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:44 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:48:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Flow 'volume_create_manager' (cb944dce-1e19-43bd-bef8-2354aec8b894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01e240e4-b91e-415e-bbe8-1351850c0b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01e240e4-b91e-415e-bbe8-1351850c0b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-680312245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a36488-b56b-490d-b09b-46680e1dc19d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2acfd7a95ae04e6a8c97cbd4d6771d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:45Z,use_quota=True,user_id='c8e50c716ff74461bb8f1c33607ef860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (285dafa6-6bfd-4507-8cea-089a4bda41be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (285dafa6-6bfd-4507-8cea-089a4bda41be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2beb8930-c835-4eed-a9aa-795cfd22cb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2beb8930-c835-4eed-a9aa-795cfd22cb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81a36488-b56b-490d-b09b-46680e1dc19d', 'volume_name': 'volume-81a36488-b56b-490d-b09b-46680e1dc19d', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (418f78b7-e6b0-4aca-aa88-36dc7e261105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (418f78b7-e6b0-4aca-aa88-36dc7e261105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:44 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c98af831-a183-482e-8f27-bb30b0ba7030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:44 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Volume 81a36488-b56b-490d-b09b-46680e1dc19d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81a36488-b56b-490d-b09b-46680e1dc19d', 'volume_size': 1} Jul 06 15:48:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-680312245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a36488-b56b-490d-b09b-46680e1dc19d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2acfd7a95ae04e6a8c97cbd4d6771d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:45Z,use_quota=True,user_id='c8e50c716ff74461bb8f1c33607ef860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:48:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Creating volume 81a36488-b56b-490d-b09b-46680e1dc19d {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:48:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:48:45 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:48:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:45 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d 1073741824 Jul 06 15:48:45 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:45 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4a30eea7-d5bc-46b2-9aa5-2ab138a02cb2 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.998s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:45 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-4a30eea7-d5bc-46b2-9aa5-2ab138a02cb2 tempest-ProjectMemberTests-765095290 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:48:45 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-4a30eea7-d5bc-46b2-9aa5-2ab138a02cb2 tempest-ProjectMemberTests-765095290 None] Deleted volume successfully. Jul 06 15:48:45 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4a30eea7-d5bc-46b2-9aa5-2ab138a02cb2 tempest-ProjectMemberTests-765095290 None] Lock "cinder-df61febf-9da1-4adb-8302-a9db4b0be4a4-delete_volume" released by "delete_volume" :: held 3.191s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:45 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-91478d25-495b-4d77-9754-e8128fa30e38 tempest-CinderUnicodeTest-592723457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908.32e35adb-eb1e-45c3-8c74-b4f01a6357d1" returned: 0 in 1.213s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-91478d25-495b-4d77-9754-e8128fa30e38 tempest-CinderUnicodeTest-592723457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908.32e35adb-eb1e-45c3-8c74-b4f01a6357d1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:45 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908.32e35adb-eb1e-45c3-8c74-b4f01a6357d1 Jul 06 15:48:45 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:45 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e6713e6a-4b04-40e8-8e29-4933c883be3e tempest-ProjectReaderTests-1147876465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-08f99c93-ff32-48c1-9bec-7f0cd48f9096" returned: 0 in 1.267s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e6713e6a-4b04-40e8-8e29-4933c883be3e tempest-ProjectReaderTests-1147876465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-08f99c93-ff32-48c1-9bec-7f0cd48f9096 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:45 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-08f99c93-ff32-48c1-9bec-7f0cd48f9096 Jul 06 15:48:45 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:46 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d 1073741824" returned: 0 in 1.018s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:46 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d Jul 06 15:48:46 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:46 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-91478d25-495b-4d77-9754-e8128fa30e38 tempest-CinderUnicodeTest-592723457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908.32e35adb-eb1e-45c3-8c74-b4f01a6357d1" returned: 0 in 0.901s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-91478d25-495b-4d77-9754-e8128fa30e38 tempest-CinderUnicodeTest-592723457 None] Lock "cinder-quobyte-32e35adb-eb1e-45c3-8c74-b4f01a6357d1" released by "_delete_snapshot" :: held 3.965s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-91478d25-495b-4d77-9754-e8128fa30e38 tempest-CinderUnicodeTest-592723457 None] Lock "cinder-quobyte-a68fcca7-39ca-43bd-a9b4-f19704835908" released by "delete_snapshot" :: held 4.003s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:46 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-91478d25-495b-4d77-9754-e8128fa30e38 tempest-CinderUnicodeTest-592723457 None] Created reservations ['0f2964d8-c1a5-487a-93c6-98eb86462397', 'dbf229f9-f138-4928-b991-43b8552ad78e', '1fc9397d-3f07-44cf-9ec9-52e4e6f3c11b', '8a36253d-4fc7-461a-8c9c-2dba18332aba'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:46 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e6713e6a-4b04-40e8-8e29-4933c883be3e tempest-ProjectReaderTests-1147876465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-08f99c93-ff32-48c1-9bec-7f0cd48f9096" returned: 0 in 0.847s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e6713e6a-4b04-40e8-8e29-4933c883be3e tempest-ProjectReaderTests-1147876465 None] Lock "cinder-quobyte-08f99c93-ff32-48c1-9bec-7f0cd48f9096" released by "delete_volume" :: held 2.212s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b4a984d5-7a4c-474c-a767-df5dd6432f02 tempest-CinderUnicodeTest-592723457 None] Acquiring lock "cinder-a68fcca7-39ca-43bd-a9b4-f19704835908-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:46 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-91478d25-495b-4d77-9754-e8128fa30e38 tempest-CinderUnicodeTest-592723457 None] Delete snapshot completed successfully. Jul 06 15:48:46 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-e6713e6a-4b04-40e8-8e29-4933c883be3e tempest-ProjectReaderTests-1147876465 None] Created reservations ['6ff6c706-0042-4167-8e60-5774b5494896', '8b40118a-7fd7-408b-bc37-b0012e64504c', '42fa63bd-6f17-4ebe-afce-4913c2930a86', 'c9b4cca5-bd61-47c3-aa29-38b4229856b8'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-91478d25-495b-4d77-9754-e8128fa30e38 tempest-CinderUnicodeTest-592723457 None] Lock "cinder-32e35adb-eb1e-45c3-8c74-b4f01a6357d1-delete_snapshot" released by "delete_snapshot" :: held 4.362s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b4a984d5-7a4c-474c-a767-df5dd6432f02 tempest-CinderUnicodeTest-592723457 None] Lock "cinder-a68fcca7-39ca-43bd-a9b4-f19704835908-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b4a984d5-7a4c-474c-a767-df5dd6432f02 tempest-CinderUnicodeTest-592723457 None] Acquiring lock "cinder-quobyte-a68fcca7-39ca-43bd-a9b4-f19704835908" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:46 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b4a984d5-7a4c-474c-a767-df5dd6432f02 tempest-CinderUnicodeTest-592723457 None] Lock "cinder-quobyte-a68fcca7-39ca-43bd-a9b4-f19704835908" acquired by "delete_volume" :: waited 0.032s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e6713e6a-4b04-40e8-8e29-4933c883be3e tempest-ProjectReaderTests-1147876465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e6713e6a-4b04-40e8-8e29-4933c883be3e tempest-ProjectReaderTests-1147876465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e6713e6a-4b04-40e8-8e29-4933c883be3e tempest-ProjectReaderTests-1147876465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-e6713e6a-4b04-40e8-8e29-4933c883be3e tempest-ProjectReaderTests-1147876465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e6713e6a-4b04-40e8-8e29-4933c883be3e tempest-ProjectReaderTests-1147876465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e6713e6a-4b04-40e8-8e29-4933c883be3e tempest-ProjectReaderTests-1147876465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:46 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d469078-2a64-4bc0-88a8-67c1da83935a]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4a984d5-7a4c-474c-a767-df5dd6432f02 tempest-CinderUnicodeTest-592723457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:46 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:48:46 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:46 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908 Jul 06 15:48:46 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:47 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d" returned: 0 in 1.045s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:47 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] <== create_volume: return (2110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:48:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.115s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:47 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c98af831-a183-482e-8f27-bb30b0ba7030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81a36488-b56b-490d-b09b-46680e1dc19d', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:47 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b4df1a-d03e-4660-a3f2-6157f25cb754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:47 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Volume volume-81a36488-b56b-490d-b09b-46680e1dc19d (81a36488-b56b-490d-b09b-46680e1dc19d): created successfully Jul 06 15:48:47 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b4df1a-d03e-4660-a3f2-6157f25cb754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:47 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Flow 'volume_create_manager' (cb944dce-1e19-43bd-bef8-2354aec8b894) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:47 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-2374b74d-3fe0-45ef-9e7d-3879952aa4b5 tempest-ProjectMemberTests-765095290 None] Created volume successfully. Jul 06 15:48:47 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-e6713e6a-4b04-40e8-8e29-4933c883be3e tempest-ProjectReaderTests-1147876465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.705s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:47 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-e6713e6a-4b04-40e8-8e29-4933c883be3e tempest-ProjectReaderTests-1147876465 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:48:47 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-e6713e6a-4b04-40e8-8e29-4933c883be3e tempest-ProjectReaderTests-1147876465 None] Deleted volume successfully. Jul 06 15:48:47 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-e6713e6a-4b04-40e8-8e29-4933c883be3e tempest-ProjectReaderTests-1147876465 None] Lock "cinder-08f99c93-ff32-48c1-9bec-7f0cd48f9096-delete_volume" released by "delete_volume" :: held 3.467s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:47 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4a984d5-7a4c-474c-a767-df5dd6432f02 tempest-CinderUnicodeTest-592723457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908" returned: 0 in 0.851s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4a984d5-7a4c-474c-a767-df5dd6432f02 tempest-CinderUnicodeTest-592723457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:47 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908 Jul 06 15:48:47 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1ac314df-dd23-4d2f-8e9a-6d0479889385 tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1ac314df-dd23-4d2f-8e9a-6d0479889385 tempest-ProjectMemberTests-765095290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:48 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-1ac314df-dd23-4d2f-8e9a-6d0479889385 tempest-ProjectMemberTests-765095290 None] Creating offline snapshot 83b1fe03-761e-437a-9abf-369b480c6635 of volume 81a36488-b56b-490d-b09b-46680e1dc19d {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:48:48 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[a976a240-1a69-4edd-910f-d43639f902ef]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1ac314df-dd23-4d2f-8e9a-6d0479889385 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:48 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4a984d5-7a4c-474c-a767-df5dd6432f02 tempest-CinderUnicodeTest-592723457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a68fcca7-39ca-43bd-a9b4-f19704835908" returned: 0 in 0.744s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b4a984d5-7a4c-474c-a767-df5dd6432f02 tempest-CinderUnicodeTest-592723457 None] Lock "cinder-quobyte-a68fcca7-39ca-43bd-a9b4-f19704835908" released by "delete_volume" :: held 1.717s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:48 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d Jul 06 15:48:48 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:48 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-b4a984d5-7a4c-474c-a767-df5dd6432f02 tempest-CinderUnicodeTest-592723457 None] Created reservations ['a983eb51-3a1e-4b06-bc4d-25b52c807316', '2ebac6af-4789-4e7f-ab3e-1671d8b6d98c', '18c0ce53-4472-4777-a84b-058192ab8994', 'd1afb4ab-7e6c-45b3-b192-ab2b662d6ee4'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b4a984d5-7a4c-474c-a767-df5dd6432f02 tempest-CinderUnicodeTest-592723457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b4a984d5-7a4c-474c-a767-df5dd6432f02 tempest-CinderUnicodeTest-592723457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:48 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b4a984d5-7a4c-474c-a767-df5dd6432f02 tempest-CinderUnicodeTest-592723457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:48 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-b4a984d5-7a4c-474c-a767-df5dd6432f02 tempest-CinderUnicodeTest-592723457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b4a984d5-7a4c-474c-a767-df5dd6432f02 tempest-CinderUnicodeTest-592723457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4a984d5-7a4c-474c-a767-df5dd6432f02 tempest-CinderUnicodeTest-592723457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:48 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:48:48 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2468dc32-c8c0-4558-bf84-ecdcfe20b636 tempest-CinderUnicodeTest-592723457 None] Acquiring lock "cinder-80092285-8243-4d7d-8404-404f34d4525f-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2468dc32-c8c0-4558-bf84-ecdcfe20b636 tempest-CinderUnicodeTest-592723457 None] Lock "cinder-80092285-8243-4d7d-8404-404f34d4525f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2468dc32-c8c0-4558-bf84-ecdcfe20b636 tempest-CinderUnicodeTest-592723457 None] Acquiring lock "cinder-quobyte-80092285-8243-4d7d-8404-404f34d4525f" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2468dc32-c8c0-4558-bf84-ecdcfe20b636 tempest-CinderUnicodeTest-592723457 None] Lock "cinder-quobyte-80092285-8243-4d7d-8404-404f34d4525f" acquired by "delete_volume" :: waited 0.034s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:48 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba95e3ba-3cfa-4c40-a7b5-f2a61512759c]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2468dc32-c8c0-4558-bf84-ecdcfe20b636 tempest-CinderUnicodeTest-592723457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-80092285-8243-4d7d-8404-404f34d4525f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:49 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-80092285-8243-4d7d-8404-404f34d4525f Jul 06 15:48:49 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:49 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1ac314df-dd23-4d2f-8e9a-6d0479889385 tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d" returned: 0 in 1.043s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1ac314df-dd23-4d2f-8e9a-6d0479889385 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d.83b1fe03-761e-437a-9abf-369b480c6635 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:49 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d.83b1fe03-761e-437a-9abf-369b480c6635 1G Jul 06 15:48:49 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:49 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4a984d5-7a4c-474c-a767-df5dd6432f02 tempest-CinderUnicodeTest-592723457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 1.040s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:49 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-b4a984d5-7a4c-474c-a767-df5dd6432f02 tempest-CinderUnicodeTest-592723457 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:48:49 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-b4a984d5-7a4c-474c-a767-df5dd6432f02 tempest-CinderUnicodeTest-592723457 None] Deleted volume successfully. Jul 06 15:48:49 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b4a984d5-7a4c-474c-a767-df5dd6432f02 tempest-CinderUnicodeTest-592723457 None] Lock "cinder-a68fcca7-39ca-43bd-a9b4-f19704835908-delete_volume" released by "delete_volume" :: held 3.108s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:50 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2468dc32-c8c0-4558-bf84-ecdcfe20b636 tempest-CinderUnicodeTest-592723457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-80092285-8243-4d7d-8404-404f34d4525f" returned: 0 in 1.201s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2468dc32-c8c0-4558-bf84-ecdcfe20b636 tempest-CinderUnicodeTest-592723457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-80092285-8243-4d7d-8404-404f34d4525f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:50 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-80092285-8243-4d7d-8404-404f34d4525f Jul 06 15:48:50 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:50 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1ac314df-dd23-4d2f-8e9a-6d0479889385 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d.83b1fe03-761e-437a-9abf-369b480c6635 1G" returned: 0 in 0.984s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1ac314df-dd23-4d2f-8e9a-6d0479889385 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a36488-b56b-490d-b09b-46680e1dc19d -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d.83b1fe03-761e-437a-9abf-369b480c6635 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:50 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a36488-b56b-490d-b09b-46680e1dc19d -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d.83b1fe03-761e-437a-9abf-369b480c6635 Jul 06 15:48:50 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:50 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2468dc32-c8c0-4558-bf84-ecdcfe20b636 tempest-CinderUnicodeTest-592723457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-80092285-8243-4d7d-8404-404f34d4525f" returned: 0 in 0.792s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:50 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2468dc32-c8c0-4558-bf84-ecdcfe20b636 tempest-CinderUnicodeTest-592723457 None] Lock "cinder-quobyte-80092285-8243-4d7d-8404-404f34d4525f" released by "delete_volume" :: held 2.041s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:51 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-2468dc32-c8c0-4558-bf84-ecdcfe20b636 tempest-CinderUnicodeTest-592723457 None] Created reservations ['aa0b1607-3561-453b-b073-ba6d4d639d26', '09b198dd-06ff-4263-b22b-e7698f9c1499', 'd005e58c-d072-464c-84e2-eda086960898', '86515652-3657-433c-92cd-5010ba385378'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:51 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1ac314df-dd23-4d2f-8e9a-6d0479889385 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a36488-b56b-490d-b09b-46680e1dc19d -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d.83b1fe03-761e-437a-9abf-369b480c6635" returned: 0 in 0.743s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:51 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-1ac314df-dd23-4d2f-8e9a-6d0479889385 tempest-ProjectMemberTests-765095290 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d.83b1fe03-761e-437a-9abf-369b480c6635 is being set with open permissions: ugo+rw Jul 06 15:48:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1ac314df-dd23-4d2f-8e9a-6d0479889385 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d.83b1fe03-761e-437a-9abf-369b480c6635 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:51 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d.83b1fe03-761e-437a-9abf-369b480c6635 Jul 06 15:48:51 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2468dc32-c8c0-4558-bf84-ecdcfe20b636 tempest-CinderUnicodeTest-592723457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2468dc32-c8c0-4558-bf84-ecdcfe20b636 tempest-CinderUnicodeTest-592723457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2468dc32-c8c0-4558-bf84-ecdcfe20b636 tempest-CinderUnicodeTest-592723457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2468dc32-c8c0-4558-bf84-ecdcfe20b636 tempest-CinderUnicodeTest-592723457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2468dc32-c8c0-4558-bf84-ecdcfe20b636 tempest-CinderUnicodeTest-592723457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2468dc32-c8c0-4558-bf84-ecdcfe20b636 tempest-CinderUnicodeTest-592723457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:51 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:48:51 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:51 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1ac314df-dd23-4d2f-8e9a-6d0479889385 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d.83b1fe03-761e-437a-9abf-369b480c6635" returned: 0 in 0.729s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1ac314df-dd23-4d2f-8e9a-6d0479889385 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:51 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d.info Jul 06 15:48:51 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:52 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2468dc32-c8c0-4558-bf84-ecdcfe20b636 tempest-CinderUnicodeTest-592723457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.800s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:52 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-2468dc32-c8c0-4558-bf84-ecdcfe20b636 tempest-CinderUnicodeTest-592723457 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:48:52 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-2468dc32-c8c0-4558-bf84-ecdcfe20b636 tempest-CinderUnicodeTest-592723457 None] Deleted volume successfully. Jul 06 15:48:52 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2468dc32-c8c0-4558-bf84-ecdcfe20b636 tempest-CinderUnicodeTest-592723457 None] Lock "cinder-80092285-8243-4d7d-8404-404f34d4525f-delete_volume" released by "delete_volume" :: held 3.215s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:52 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1ac314df-dd23-4d2f-8e9a-6d0479889385 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d.info" returned: 0 in 0.803s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:52 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-1ac314df-dd23-4d2f-8e9a-6d0479889385 tempest-ProjectMemberTests-765095290 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d.info is being set with open permissions: ugo+rw Jul 06 15:48:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1ac314df-dd23-4d2f-8e9a-6d0479889385 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:52 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d.info Jul 06 15:48:52 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:53 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1ac314df-dd23-4d2f-8e9a-6d0479889385 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d.info" returned: 0 in 0.763s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1ac314df-dd23-4d2f-8e9a-6d0479889385 tempest-ProjectMemberTests-765095290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.172s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:53 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-1ac314df-dd23-4d2f-8e9a-6d0479889385 tempest-ProjectMemberTests-765095290 None] Create snapshot completed successfully Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Flow 'volume_create_manager' (da270d12-2f01-4c11-b4ca-a2e19add26ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c3aad18-0599-4381-8d57-9bf4f2129d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c3aad18-0599-4381-8d57-9bf4f2129d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-192218325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2127c2b1-0254-4d5c-a41c-af996859940b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ef8b6d74c840deb320e6dead13534d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:54Z,use_quota=True,user_id='c05a8530934e4792bd47095b6f6e57b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379dc2c4-dad8-4804-8200-5e832dec1f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379dc2c4-dad8-4804-8200-5e832dec1f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c32b3e-a4a4-49df-93f0-88614e579f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c32b3e-a4a4-49df-93f0-88614e579f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2127c2b1-0254-4d5c-a41c-af996859940b', 'volume_name': 'volume-2127c2b1-0254-4d5c-a41c-af996859940b', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d268dc58-0e79-4c17-afb0-0155ac2df639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d268dc58-0e79-4c17-afb0-0155ac2df639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1153556-2ed0-46d4-8a6f-3b76bb3d4907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:54 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Volume 2127c2b1-0254-4d5c-a41c-af996859940b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2127c2b1-0254-4d5c-a41c-af996859940b', 'volume_size': 1} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-192218325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2127c2b1-0254-4d5c-a41c-af996859940b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ef8b6d74c840deb320e6dead13534d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:54Z,use_quota=True,user_id='c05a8530934e4792bd47095b6f6e57b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Creating volume 2127c2b1-0254-4d5c-a41c-af996859940b {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:48:54 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:54 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b 1073741824 Jul 06 15:48:54 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-0d595821-adff-4e4c-859b-708071cf7181 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-83b1fe03-761e-437a-9abf-369b480c6635-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-0d595821-adff-4e4c-859b-708071cf7181 tempest-ProjectMemberTests-765095290 None] Lock "cinder-83b1fe03-761e-437a-9abf-369b480c6635-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-0d595821-adff-4e4c-859b-708071cf7181 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-quobyte-81a36488-b56b-490d-b09b-46680e1dc19d" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-0d595821-adff-4e4c-859b-708071cf7181 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-81a36488-b56b-490d-b09b-46680e1dc19d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-0d595821-adff-4e4c-859b-708071cf7181 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-quobyte-83b1fe03-761e-437a-9abf-369b480c6635" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-0d595821-adff-4e4c-859b-708071cf7181 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-83b1fe03-761e-437a-9abf-369b480c6635" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-0d595821-adff-4e4c-859b-708071cf7181 tempest-ProjectMemberTests-765095290 None] Deleting offline snapshot 83b1fe03-761e-437a-9abf-369b480c6635 of volume 81a36488-b56b-490d-b09b-46680e1dc19d {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-0d595821-adff-4e4c-859b-708071cf7181 tempest-ProjectMemberTests-765095290 None] snapshot_file for this snap is: volume-81a36488-b56b-490d-b09b-46680e1dc19d.83b1fe03-761e-437a-9abf-369b480c6635 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c1ffdf-e6bf-4253-9a3b-fc58744e7b21]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0d595821-adff-4e4c-859b-708071cf7181 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d.83b1fe03-761e-437a-9abf-369b480c6635 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:54 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d.83b1fe03-761e-437a-9abf-369b480c6635 Jul 06 15:48:54 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:55 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b 1073741824" returned: 0 in 0.956s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:55 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b Jul 06 15:48:55 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:55 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0d595821-adff-4e4c-859b-708071cf7181 tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d.83b1fe03-761e-437a-9abf-369b480c6635" returned: 0 in 0.852s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:55 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-0d595821-adff-4e4c-859b-708071cf7181 tempest-ProjectMemberTests-765095290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81a36488-b56b-490d-b09b-46680e1dc19d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:48:55 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bf96d3-af2d-46f1-b933-4dc584340593]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0d595821-adff-4e4c-859b-708071cf7181 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:55 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d Jul 06 15:48:55 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:56 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b" returned: 0 in 0.683s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:48:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1153556-2ed0-46d4-8a6f-3b76bb3d4907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2127c2b1-0254-4d5c-a41c-af996859940b', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a360707-20c2-407b-b105-54c7a98151a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:56 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Volume volume-2127c2b1-0254-4d5c-a41c-af996859940b (2127c2b1-0254-4d5c-a41c-af996859940b): created successfully Jul 06 15:48:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a360707-20c2-407b-b105-54c7a98151a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Flow 'volume_create_manager' (da270d12-2f01-4c11-b4ca-a2e19add26ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:56 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-3e4fe455-7288-4dc6-9ad5-6c6ab2da41a6 tempest-ProjectReaderTests-367541805 None] Created volume successfully. Jul 06 15:48:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-33b1269a-43fa-4c63-a9b8-587497fa582b tempest-ProjectAdminTests-202102582 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86148) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 06 15:48:56 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0d595821-adff-4e4c-859b-708071cf7181 tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d" returned: 0 in 0.844s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0d595821-adff-4e4c-859b-708071cf7181 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d.83b1fe03-761e-437a-9abf-369b480c6635 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:56 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d.83b1fe03-761e-437a-9abf-369b480c6635 Jul 06 15:48:56 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-cc16507e-121c-4440-9602-f6dc897685dd tempest-ProjectReaderTests-367541805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-cc16507e-121c-4440-9602-f6dc897685dd tempest-ProjectReaderTests-367541805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-cc16507e-121c-4440-9602-f6dc897685dd tempest-ProjectReaderTests-367541805 None] Creating offline snapshot b9a02ccb-4cc5-4372-a449-dd6bf02ec2b1 of volume 2127c2b1-0254-4d5c-a41c-af996859940b {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:48:56 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07331c1-2f81-446f-bbf2-312b4578c07d]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cc16507e-121c-4440-9602-f6dc897685dd tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:56 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b Jul 06 15:48:56 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:57 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0d595821-adff-4e4c-859b-708071cf7181 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d.83b1fe03-761e-437a-9abf-369b480c6635" returned: 0 in 0.797s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0d595821-adff-4e4c-859b-708071cf7181 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d.83b1fe03-761e-437a-9abf-369b480c6635 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:57 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d.83b1fe03-761e-437a-9abf-369b480c6635 Jul 06 15:48:57 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:57 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cc16507e-121c-4440-9602-f6dc897685dd tempest-ProjectReaderTests-367541805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b" returned: 0 in 0.800s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cc16507e-121c-4440-9602-f6dc897685dd tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b.b9a02ccb-4cc5-4372-a449-dd6bf02ec2b1 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:57 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b.b9a02ccb-4cc5-4372-a449-dd6bf02ec2b1 1G Jul 06 15:48:57 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:57 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-0d595821-adff-4e4c-859b-708071cf7181 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d.83b1fe03-761e-437a-9abf-369b480c6635" returned: 0 in 0.697s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:57 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-0d595821-adff-4e4c-859b-708071cf7181 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-83b1fe03-761e-437a-9abf-369b480c6635" released by "_delete_snapshot" :: held 3.322s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:58 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-0d595821-adff-4e4c-859b-708071cf7181 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-81a36488-b56b-490d-b09b-46680e1dc19d" released by "delete_snapshot" :: held 3.351s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:58 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-0d595821-adff-4e4c-859b-708071cf7181 tempest-ProjectMemberTests-765095290 None] Created reservations ['7a7bc5c0-4585-4e4f-85f9-583a9cdc807a', '6947a6c1-88d0-412b-b357-18cb90def6e0', 'c6af1522-5929-4945-88cf-1206413cff8f', '3ccf5875-4623-4427-86f7-0dfe698b0069'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:58 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-0d595821-adff-4e4c-859b-708071cf7181 tempest-ProjectMemberTests-765095290 None] Delete snapshot completed successfully. Jul 06 15:48:58 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-0d595821-adff-4e4c-859b-708071cf7181 tempest-ProjectMemberTests-765095290 None] Lock "cinder-83b1fe03-761e-437a-9abf-369b480c6635-delete_snapshot" released by "delete_snapshot" :: held 3.532s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:58 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cc16507e-121c-4440-9602-f6dc897685dd tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b.b9a02ccb-4cc5-4372-a449-dd6bf02ec2b1 1G" returned: 0 in 0.899s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cc16507e-121c-4440-9602-f6dc897685dd tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2127c2b1-0254-4d5c-a41c-af996859940b -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b.b9a02ccb-4cc5-4372-a449-dd6bf02ec2b1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:58 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2127c2b1-0254-4d5c-a41c-af996859940b -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b.b9a02ccb-4cc5-4372-a449-dd6bf02ec2b1 Jul 06 15:48:58 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:58 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a54d313d-efcc-4d02-b74d-0cc1348fe698 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-81a36488-b56b-490d-b09b-46680e1dc19d-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:58 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a54d313d-efcc-4d02-b74d-0cc1348fe698 tempest-ProjectMemberTests-765095290 None] Lock "cinder-81a36488-b56b-490d-b09b-46680e1dc19d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a54d313d-efcc-4d02-b74d-0cc1348fe698 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-quobyte-81a36488-b56b-490d-b09b-46680e1dc19d" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:59 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a54d313d-efcc-4d02-b74d-0cc1348fe698 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-81a36488-b56b-490d-b09b-46680e1dc19d" acquired by "delete_volume" :: waited 0.015s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cc16507e-121c-4440-9602-f6dc897685dd tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2127c2b1-0254-4d5c-a41c-af996859940b -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b.b9a02ccb-4cc5-4372-a449-dd6bf02ec2b1" returned: 0 in 0.787s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:59 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-cc16507e-121c-4440-9602-f6dc897685dd tempest-ProjectReaderTests-367541805 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b.b9a02ccb-4cc5-4372-a449-dd6bf02ec2b1 is being set with open permissions: ugo+rw Jul 06 15:48:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cc16507e-121c-4440-9602-f6dc897685dd tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b.b9a02ccb-4cc5-4372-a449-dd6bf02ec2b1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:59 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[580099d0-c0b4-4275-9378-8a3b870128ed]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a54d313d-efcc-4d02-b74d-0cc1348fe698 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:59 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b.b9a02ccb-4cc5-4372-a449-dd6bf02ec2b1 Jul 06 15:48:59 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:59 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d Jul 06 15:48:59 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:59 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cc16507e-121c-4440-9602-f6dc897685dd tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b.b9a02ccb-4cc5-4372-a449-dd6bf02ec2b1" returned: 0 in 0.680s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cc16507e-121c-4440-9602-f6dc897685dd tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:59 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b.info Jul 06 15:48:59 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:59 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a54d313d-efcc-4d02-b74d-0cc1348fe698 tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d" returned: 0 in 0.799s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a54d313d-efcc-4d02-b74d-0cc1348fe698 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:59 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d Jul 06 15:48:59 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:00 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cc16507e-121c-4440-9602-f6dc897685dd tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b.info" returned: 0 in 0.663s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:00 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-cc16507e-121c-4440-9602-f6dc897685dd tempest-ProjectReaderTests-367541805 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b.info is being set with open permissions: ugo+rw Jul 06 15:49:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cc16507e-121c-4440-9602-f6dc897685dd tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:00 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b.info Jul 06 15:49:00 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:00 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a54d313d-efcc-4d02-b74d-0cc1348fe698 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-81a36488-b56b-490d-b09b-46680e1dc19d" returned: 0 in 0.707s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:00 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a54d313d-efcc-4d02-b74d-0cc1348fe698 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-81a36488-b56b-490d-b09b-46680e1dc19d" released by "delete_volume" :: held 1.583s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:00 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-a54d313d-efcc-4d02-b74d-0cc1348fe698 tempest-ProjectMemberTests-765095290 None] Created reservations ['0b8f6a9f-45f5-4d83-9af5-e2fc810431b6', '4a2442a3-2faa-4499-942d-6b8299461578', '2fba9696-05fe-466c-8697-0e255c0cb2a6', '961978f1-6a2e-4b77-969d-a478ef29d278'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:49:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a54d313d-efcc-4d02-b74d-0cc1348fe698 tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a54d313d-efcc-4d02-b74d-0cc1348fe698 tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:00 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a54d313d-efcc-4d02-b74d-0cc1348fe698 tempest-ProjectMemberTests-765095290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:00 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a54d313d-efcc-4d02-b74d-0cc1348fe698 tempest-ProjectMemberTests-765095290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a54d313d-efcc-4d02-b74d-0cc1348fe698 tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a54d313d-efcc-4d02-b74d-0cc1348fe698 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:00 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:49:00 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:01 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-cc16507e-121c-4440-9602-f6dc897685dd tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b.info" returned: 0 in 0.633s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-cc16507e-121c-4440-9602-f6dc897685dd tempest-ProjectReaderTests-367541805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.564s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:01 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-cc16507e-121c-4440-9602-f6dc897685dd tempest-ProjectReaderTests-367541805 None] Create snapshot completed successfully Jul 06 15:49:01 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a54d313d-efcc-4d02-b74d-0cc1348fe698 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.722s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:01 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-a54d313d-efcc-4d02-b74d-0cc1348fe698 tempest-ProjectMemberTests-765095290 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:49:01 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a54d313d-efcc-4d02-b74d-0cc1348fe698 tempest-ProjectMemberTests-765095290 None] Deleted volume successfully. Jul 06 15:49:01 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a54d313d-efcc-4d02-b74d-0cc1348fe698 tempest-ProjectMemberTests-765095290 None] Lock "cinder-81a36488-b56b-490d-b09b-46680e1dc19d-delete_volume" released by "delete_volume" :: held 2.555s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:01 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:49:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Flow 'volume_create_manager' (4aeae665-9331-4a69-bc07-84ba912d0c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:49:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a0ffa5-7f31-4bfc-85cd-52de448d9624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a0ffa5-7f31-4bfc-85cd-52de448d9624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-668715888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c49d33-135b-424f-a4b6-cebfda710a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2acfd7a95ae04e6a8c97cbd4d6771d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:02Z,use_quota=True,user_id='c8e50c716ff74461bb8f1c33607ef860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80501eab-4d24-4232-8d71-508042f6d516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80501eab-4d24-4232-8d71-508042f6d516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce12e656-1ed5-4200-89b6-9f50c212ac78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce12e656-1ed5-4200-89b6-9f50c212ac78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95c49d33-135b-424f-a4b6-cebfda710a06', 'volume_name': 'volume-95c49d33-135b-424f-a4b6-cebfda710a06', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c6414bd-a495-4096-9d65-163916926770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c6414bd-a495-4096-9d65-163916926770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f20c31-c533-4a91-bfdf-e9d02a41dfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:01 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Volume 95c49d33-135b-424f-a4b6-cebfda710a06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95c49d33-135b-424f-a4b6-cebfda710a06', 'volume_size': 1} Jul 06 15:49:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-668715888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c49d33-135b-424f-a4b6-cebfda710a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2acfd7a95ae04e6a8c97cbd4d6771d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:02Z,use_quota=True,user_id='c8e50c716ff74461bb8f1c33607ef860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:49:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Creating volume 95c49d33-135b-424f-a4b6-cebfda710a06 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:49:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:49:01 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:49:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:01 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06 1073741824 Jul 06 15:49:01 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:01 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d7339fe3-ff38-44e8-9e6c-9c955d6d3233 tempest-ProjectReaderTests-367541805 None] Acquiring lock "cinder-b9a02ccb-4cc5-4372-a449-dd6bf02ec2b1-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:02 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d7339fe3-ff38-44e8-9e6c-9c955d6d3233 tempest-ProjectReaderTests-367541805 None] Lock "cinder-b9a02ccb-4cc5-4372-a449-dd6bf02ec2b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:02 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d7339fe3-ff38-44e8-9e6c-9c955d6d3233 tempest-ProjectReaderTests-367541805 None] Acquiring lock "cinder-quobyte-2127c2b1-0254-4d5c-a41c-af996859940b" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:02 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d7339fe3-ff38-44e8-9e6c-9c955d6d3233 tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-2127c2b1-0254-4d5c-a41c-af996859940b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:02 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d7339fe3-ff38-44e8-9e6c-9c955d6d3233 tempest-ProjectReaderTests-367541805 None] Acquiring lock "cinder-quobyte-b9a02ccb-4cc5-4372-a449-dd6bf02ec2b1" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:02 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d7339fe3-ff38-44e8-9e6c-9c955d6d3233 tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-b9a02ccb-4cc5-4372-a449-dd6bf02ec2b1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:02 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-d7339fe3-ff38-44e8-9e6c-9c955d6d3233 tempest-ProjectReaderTests-367541805 None] Deleting offline snapshot b9a02ccb-4cc5-4372-a449-dd6bf02ec2b1 of volume 2127c2b1-0254-4d5c-a41c-af996859940b {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:49:02 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-d7339fe3-ff38-44e8-9e6c-9c955d6d3233 tempest-ProjectReaderTests-367541805 None] snapshot_file for this snap is: volume-2127c2b1-0254-4d5c-a41c-af996859940b.b9a02ccb-4cc5-4372-a449-dd6bf02ec2b1 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:49:02 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6f65df-6b47-4ca7-94e9-e23aeb254697]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d7339fe3-ff38-44e8-9e6c-9c955d6d3233 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b.b9a02ccb-4cc5-4372-a449-dd6bf02ec2b1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:02 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b.b9a02ccb-4cc5-4372-a449-dd6bf02ec2b1 Jul 06 15:49:02 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:02 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06 1073741824" returned: 0 in 0.978s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:02 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06 Jul 06 15:49:02 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:02 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d7339fe3-ff38-44e8-9e6c-9c955d6d3233 tempest-ProjectReaderTests-367541805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b.b9a02ccb-4cc5-4372-a449-dd6bf02ec2b1" returned: 0 in 0.834s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:02 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-d7339fe3-ff38-44e8-9e6c-9c955d6d3233 tempest-ProjectReaderTests-367541805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2127c2b1-0254-4d5c-a41c-af996859940b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:49:02 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea5e968-6889-4cda-80f5-af7b4e67b366]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d7339fe3-ff38-44e8-9e6c-9c955d6d3233 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:03 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b Jul 06 15:49:03 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:03 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06" returned: 0 in 0.678s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:03 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:49:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f20c31-c533-4a91-bfdf-e9d02a41dfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95c49d33-135b-424f-a4b6-cebfda710a06', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bc92f22-610e-47be-86c7-599b393702bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:03 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Volume volume-95c49d33-135b-424f-a4b6-cebfda710a06 (95c49d33-135b-424f-a4b6-cebfda710a06): created successfully Jul 06 15:49:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bc92f22-610e-47be-86c7-599b393702bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:03 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Flow 'volume_create_manager' (4aeae665-9331-4a69-bc07-84ba912d0c67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:49:03 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-dba4c3d2-3531-408e-86da-6d68a396755f tempest-ProjectMemberTests-765095290 None] Created volume successfully. Jul 06 15:49:03 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d7339fe3-ff38-44e8-9e6c-9c955d6d3233 tempest-ProjectReaderTests-367541805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b" returned: 0 in 0.839s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d7339fe3-ff38-44e8-9e6c-9c955d6d3233 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b.b9a02ccb-4cc5-4372-a449-dd6bf02ec2b1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:03 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b.b9a02ccb-4cc5-4372-a449-dd6bf02ec2b1 Jul 06 15:49:03 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:03 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:UPDATE=222,cinder:DELETE=22,cinder:SELECT=163,cinder:INSERT=59 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:49:03 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=148,cinder:UPDATE=218,cinder:INSERT=50,cinder:DELETE=17 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:49:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7e85f1d0-05fc-4be8-b3ce-4a1f47ec32f5 tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7e85f1d0-05fc-4be8-b3ce-4a1f47ec32f5 tempest-ProjectMemberTests-765095290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:03 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-7e85f1d0-05fc-4be8-b3ce-4a1f47ec32f5 tempest-ProjectMemberTests-765095290 None] Creating offline snapshot 436cb72d-cc96-41c1-a7ee-29a8dede1126 of volume 95c49d33-135b-424f-a4b6-cebfda710a06 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:49:04 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fda9846-8d0a-452e-a0f9-b70beec81c07]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7e85f1d0-05fc-4be8-b3ce-4a1f47ec32f5 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:04 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06 Jul 06 15:49:04 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:04 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d7339fe3-ff38-44e8-9e6c-9c955d6d3233 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b.b9a02ccb-4cc5-4372-a449-dd6bf02ec2b1" returned: 0 in 0.802s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d7339fe3-ff38-44e8-9e6c-9c955d6d3233 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b.b9a02ccb-4cc5-4372-a449-dd6bf02ec2b1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:04 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b.b9a02ccb-4cc5-4372-a449-dd6bf02ec2b1 Jul 06 15:49:04 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:04 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7e85f1d0-05fc-4be8-b3ce-4a1f47ec32f5 tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06" returned: 0 in 0.868s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7e85f1d0-05fc-4be8-b3ce-4a1f47ec32f5 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06.436cb72d-cc96-41c1-a7ee-29a8dede1126 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:04 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06.436cb72d-cc96-41c1-a7ee-29a8dede1126 1G Jul 06 15:49:04 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:05 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d7339fe3-ff38-44e8-9e6c-9c955d6d3233 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b.b9a02ccb-4cc5-4372-a449-dd6bf02ec2b1" returned: 0 in 0.688s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:05 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d7339fe3-ff38-44e8-9e6c-9c955d6d3233 tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-b9a02ccb-4cc5-4372-a449-dd6bf02ec2b1" released by "_delete_snapshot" :: held 3.280s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:05 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d7339fe3-ff38-44e8-9e6c-9c955d6d3233 tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-2127c2b1-0254-4d5c-a41c-af996859940b" released by "delete_snapshot" :: held 3.310s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:05 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-d7339fe3-ff38-44e8-9e6c-9c955d6d3233 tempest-ProjectReaderTests-367541805 None] Created reservations ['5f12043c-b6e3-44c7-a139-19fc801df548', '66828de0-1d3f-4225-ad0d-5095f2dd93bd', '95324e0f-43b8-4bea-a7aa-3ea2ad0b9d14', 'bdd68fc2-ddae-400a-87e3-64409a4e2da7'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:49:05 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-d7339fe3-ff38-44e8-9e6c-9c955d6d3233 tempest-ProjectReaderTests-367541805 None] Delete snapshot completed successfully. Jul 06 15:49:05 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d7339fe3-ff38-44e8-9e6c-9c955d6d3233 tempest-ProjectReaderTests-367541805 None] Lock "cinder-b9a02ccb-4cc5-4372-a449-dd6bf02ec2b1-delete_snapshot" released by "delete_snapshot" :: held 3.471s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:05 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7e85f1d0-05fc-4be8-b3ce-4a1f47ec32f5 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06.436cb72d-cc96-41c1-a7ee-29a8dede1126 1G" returned: 0 in 0.830s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7e85f1d0-05fc-4be8-b3ce-4a1f47ec32f5 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95c49d33-135b-424f-a4b6-cebfda710a06 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06.436cb72d-cc96-41c1-a7ee-29a8dede1126 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:05 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95c49d33-135b-424f-a4b6-cebfda710a06 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06.436cb72d-cc96-41c1-a7ee-29a8dede1126 Jul 06 15:49:05 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:06 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d7454f15-bd09-4679-98d2-82a50a50afaa tempest-ProjectReaderTests-367541805 None] Acquiring lock "cinder-2127c2b1-0254-4d5c-a41c-af996859940b-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:06 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d7454f15-bd09-4679-98d2-82a50a50afaa tempest-ProjectReaderTests-367541805 None] Lock "cinder-2127c2b1-0254-4d5c-a41c-af996859940b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:06 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d7454f15-bd09-4679-98d2-82a50a50afaa tempest-ProjectReaderTests-367541805 None] Acquiring lock "cinder-quobyte-2127c2b1-0254-4d5c-a41c-af996859940b" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:06 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d7454f15-bd09-4679-98d2-82a50a50afaa tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-2127c2b1-0254-4d5c-a41c-af996859940b" acquired by "delete_volume" :: waited 0.017s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:06 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdecc74a-8d83-4e09-a3e5-2a2cc9b6c7cd]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d7454f15-bd09-4679-98d2-82a50a50afaa tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:06 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7e85f1d0-05fc-4be8-b3ce-4a1f47ec32f5 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95c49d33-135b-424f-a4b6-cebfda710a06 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06.436cb72d-cc96-41c1-a7ee-29a8dede1126" returned: 0 in 0.725s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:06 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-7e85f1d0-05fc-4be8-b3ce-4a1f47ec32f5 tempest-ProjectMemberTests-765095290 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06.436cb72d-cc96-41c1-a7ee-29a8dede1126 is being set with open permissions: ugo+rw Jul 06 15:49:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7e85f1d0-05fc-4be8-b3ce-4a1f47ec32f5 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06.436cb72d-cc96-41c1-a7ee-29a8dede1126 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:06 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06.436cb72d-cc96-41c1-a7ee-29a8dede1126 Jul 06 15:49:06 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:06 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b Jul 06 15:49:06 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:07 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7e85f1d0-05fc-4be8-b3ce-4a1f47ec32f5 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06.436cb72d-cc96-41c1-a7ee-29a8dede1126" returned: 0 in 0.710s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:07 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7e85f1d0-05fc-4be8-b3ce-4a1f47ec32f5 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d7454f15-bd09-4679-98d2-82a50a50afaa tempest-ProjectReaderTests-367541805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b" returned: 0 in 0.811s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d7454f15-bd09-4679-98d2-82a50a50afaa tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:07 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06.info Jul 06 15:49:07 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:07 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b Jul 06 15:49:07 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:07 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7e85f1d0-05fc-4be8-b3ce-4a1f47ec32f5 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06.info" returned: 0 in 0.675s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:07 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-7e85f1d0-05fc-4be8-b3ce-4a1f47ec32f5 tempest-ProjectMemberTests-765095290 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06.info is being set with open permissions: ugo+rw Jul 06 15:49:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7e85f1d0-05fc-4be8-b3ce-4a1f47ec32f5 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:07 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06.info Jul 06 15:49:07 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:07 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d7454f15-bd09-4679-98d2-82a50a50afaa tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-2127c2b1-0254-4d5c-a41c-af996859940b" returned: 0 in 0.720s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:07 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d7454f15-bd09-4679-98d2-82a50a50afaa tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-2127c2b1-0254-4d5c-a41c-af996859940b" released by "delete_volume" :: held 1.605s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:07 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-d7454f15-bd09-4679-98d2-82a50a50afaa tempest-ProjectReaderTests-367541805 None] Created reservations ['daa04b6e-dce8-46e9-a1d6-1900521f2df1', '4da6fc13-6cec-4ff2-a84e-5f35a51a367c', 'fa5f346b-e0ab-4bae-be44-e8d52f6c52e4', 'f338a93b-cbae-4f7b-b5fa-47b3a1bad5a7'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:49:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d7454f15-bd09-4679-98d2-82a50a50afaa tempest-ProjectReaderTests-367541805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d7454f15-bd09-4679-98d2-82a50a50afaa tempest-ProjectReaderTests-367541805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d7454f15-bd09-4679-98d2-82a50a50afaa tempest-ProjectReaderTests-367541805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-d7454f15-bd09-4679-98d2-82a50a50afaa tempest-ProjectReaderTests-367541805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-d7454f15-bd09-4679-98d2-82a50a50afaa tempest-ProjectReaderTests-367541805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d7454f15-bd09-4679-98d2-82a50a50afaa tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:08 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:49:08 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:08 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-7e85f1d0-05fc-4be8-b3ce-4a1f47ec32f5 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06.info" returned: 0 in 0.779s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-7e85f1d0-05fc-4be8-b3ce-4a1f47ec32f5 tempest-ProjectMemberTests-765095290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.697s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:08 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-7e85f1d0-05fc-4be8-b3ce-4a1f47ec32f5 tempest-ProjectMemberTests-765095290 None] Create snapshot completed successfully Jul 06 15:49:08 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-d7454f15-bd09-4679-98d2-82a50a50afaa tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.739s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:08 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-d7454f15-bd09-4679-98d2-82a50a50afaa tempest-ProjectReaderTests-367541805 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:49:08 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-d7454f15-bd09-4679-98d2-82a50a50afaa tempest-ProjectReaderTests-367541805 None] Deleted volume successfully. Jul 06 15:49:08 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-d7454f15-bd09-4679-98d2-82a50a50afaa tempest-ProjectReaderTests-367541805 None] Lock "cinder-2127c2b1-0254-4d5c-a41c-af996859940b-delete_volume" released by "delete_volume" :: held 2.596s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Flow 'volume_create_manager' (7874a17e-a657-490b-9ec1-d818195c43c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c88bbba-2a17-4176-a7a8-fdae7255653b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c88bbba-2a17-4176-a7a8-fdae7255653b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-37324604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e651017-1fe2-4ee6-8475-1dd10a61706a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ef8b6d74c840deb320e6dead13534d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:09Z,use_quota=True,user_id='c05a8530934e4792bd47095b6f6e57b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a68618d-ad49-465e-969e-98f371e36bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a68618d-ad49-465e-969e-98f371e36bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91be26c3-63f4-4cb2-b10b-c874540a3253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91be26c3-63f4-4cb2-b10b-c874540a3253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e651017-1fe2-4ee6-8475-1dd10a61706a', 'volume_name': 'volume-6e651017-1fe2-4ee6-8475-1dd10a61706a', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fadecfe-21fa-467a-91f8-96d5ac824094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fadecfe-21fa-467a-91f8-96d5ac824094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75748aae-82d9-4568-9e45-0766a1f422fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:09 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Volume 6e651017-1fe2-4ee6-8475-1dd10a61706a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e651017-1fe2-4ee6-8475-1dd10a61706a', 'volume_size': 1} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-37324604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e651017-1fe2-4ee6-8475-1dd10a61706a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ef8b6d74c840deb320e6dead13534d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:09Z,use_quota=True,user_id='c05a8530934e4792bd47095b6f6e57b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Creating volume 6e651017-1fe2-4ee6-8475-1dd10a61706a {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:49:09 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:09 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a 1073741824 Jul 06 15:49:09 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c00ef170-9631-487e-9509-dd44097ba543 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-436cb72d-cc96-41c1-a7ee-29a8dede1126-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c00ef170-9631-487e-9509-dd44097ba543 tempest-ProjectMemberTests-765095290 None] Lock "cinder-436cb72d-cc96-41c1-a7ee-29a8dede1126-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c00ef170-9631-487e-9509-dd44097ba543 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-quobyte-95c49d33-135b-424f-a4b6-cebfda710a06" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c00ef170-9631-487e-9509-dd44097ba543 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-95c49d33-135b-424f-a4b6-cebfda710a06" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c00ef170-9631-487e-9509-dd44097ba543 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-quobyte-436cb72d-cc96-41c1-a7ee-29a8dede1126" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c00ef170-9631-487e-9509-dd44097ba543 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-436cb72d-cc96-41c1-a7ee-29a8dede1126" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-c00ef170-9631-487e-9509-dd44097ba543 tempest-ProjectMemberTests-765095290 None] Deleting offline snapshot 436cb72d-cc96-41c1-a7ee-29a8dede1126 of volume 95c49d33-135b-424f-a4b6-cebfda710a06 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-c00ef170-9631-487e-9509-dd44097ba543 tempest-ProjectMemberTests-765095290 None] snapshot_file for this snap is: volume-95c49d33-135b-424f-a4b6-cebfda710a06.436cb72d-cc96-41c1-a7ee-29a8dede1126 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e99181-62e2-46dc-aaef-ecb20b3d8378]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c00ef170-9631-487e-9509-dd44097ba543 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06.436cb72d-cc96-41c1-a7ee-29a8dede1126 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:09 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06.436cb72d-cc96-41c1-a7ee-29a8dede1126 Jul 06 15:49:09 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:09 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a 1073741824" returned: 0 in 0.800s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:10 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a Jul 06 15:49:10 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:10 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c00ef170-9631-487e-9509-dd44097ba543 tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06.436cb72d-cc96-41c1-a7ee-29a8dede1126" returned: 0 in 0.776s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:10 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-c00ef170-9631-487e-9509-dd44097ba543 tempest-ProjectMemberTests-765095290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95c49d33-135b-424f-a4b6-cebfda710a06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:49:10 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8598e7-8eca-4e0a-a5e1-14a0accef8cd]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c00ef170-9631-487e-9509-dd44097ba543 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:10 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06 Jul 06 15:49:10 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:10 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a" returned: 0 in 0.679s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:10 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:49:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75748aae-82d9-4568-9e45-0766a1f422fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e651017-1fe2-4ee6-8475-1dd10a61706a', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ae107d1-9fdc-4241-9ddb-834e9d7adbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:10 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Volume volume-6e651017-1fe2-4ee6-8475-1dd10a61706a (6e651017-1fe2-4ee6-8475-1dd10a61706a): created successfully Jul 06 15:49:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ae107d1-9fdc-4241-9ddb-834e9d7adbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:10 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Flow 'volume_create_manager' (7874a17e-a657-490b-9ec1-d818195c43c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:49:10 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-191ca6a0-4555-4255-b391-0a016a1ea3d2 tempest-ProjectReaderTests-367541805 None] Created volume successfully. Jul 06 15:49:10 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c00ef170-9631-487e-9509-dd44097ba543 tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06" returned: 0 in 0.775s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c00ef170-9631-487e-9509-dd44097ba543 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06.436cb72d-cc96-41c1-a7ee-29a8dede1126 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:10 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06.436cb72d-cc96-41c1-a7ee-29a8dede1126 Jul 06 15:49:10 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-731a8c46-e73e-4a59-ab0f-0b54352e65ee tempest-ProjectReaderTests-367541805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-731a8c46-e73e-4a59-ab0f-0b54352e65ee tempest-ProjectReaderTests-367541805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:11 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-731a8c46-e73e-4a59-ab0f-0b54352e65ee tempest-ProjectReaderTests-367541805 None] Creating offline snapshot f6d82e39-4f07-4494-b7b1-64eafd0f0f7f of volume 6e651017-1fe2-4ee6-8475-1dd10a61706a {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:49:11 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57698ef-1f6f-444f-b955-a523f060b2d1]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-731a8c46-e73e-4a59-ab0f-0b54352e65ee tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:11 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a Jul 06 15:49:11 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:11 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c00ef170-9631-487e-9509-dd44097ba543 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06.436cb72d-cc96-41c1-a7ee-29a8dede1126" returned: 0 in 0.753s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c00ef170-9631-487e-9509-dd44097ba543 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06.436cb72d-cc96-41c1-a7ee-29a8dede1126 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:11 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06.436cb72d-cc96-41c1-a7ee-29a8dede1126 Jul 06 15:49:11 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:12 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-731a8c46-e73e-4a59-ab0f-0b54352e65ee tempest-ProjectReaderTests-367541805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a" returned: 0 in 0.742s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-731a8c46-e73e-4a59-ab0f-0b54352e65ee tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a.f6d82e39-4f07-4494-b7b1-64eafd0f0f7f 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:12 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a.f6d82e39-4f07-4494-b7b1-64eafd0f0f7f 1G Jul 06 15:49:12 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:12 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-c00ef170-9631-487e-9509-dd44097ba543 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06.436cb72d-cc96-41c1-a7ee-29a8dede1126" returned: 0 in 0.647s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:12 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c00ef170-9631-487e-9509-dd44097ba543 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-436cb72d-cc96-41c1-a7ee-29a8dede1126" released by "_delete_snapshot" :: held 3.046s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:12 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c00ef170-9631-487e-9509-dd44097ba543 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-95c49d33-135b-424f-a4b6-cebfda710a06" released by "delete_snapshot" :: held 3.072s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:12 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-c00ef170-9631-487e-9509-dd44097ba543 tempest-ProjectMemberTests-765095290 None] Created reservations ['fdac4c38-f99d-44f4-b6db-0f299ae87b2e', 'c098b239-fbfe-4c47-8729-f1647cbc6e4f', '5c5af4a4-9392-4d9a-b06d-d6da41917b4f', 'b45cb38b-d92a-45c6-a26e-ad80870428f0'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:49:12 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-c00ef170-9631-487e-9509-dd44097ba543 tempest-ProjectMemberTests-765095290 None] Delete snapshot completed successfully. Jul 06 15:49:12 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-c00ef170-9631-487e-9509-dd44097ba543 tempest-ProjectMemberTests-765095290 None] Lock "cinder-436cb72d-cc96-41c1-a7ee-29a8dede1126-delete_snapshot" released by "delete_snapshot" :: held 3.213s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:12 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-731a8c46-e73e-4a59-ab0f-0b54352e65ee tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a.f6d82e39-4f07-4494-b7b1-64eafd0f0f7f 1G" returned: 0 in 0.831s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-731a8c46-e73e-4a59-ab0f-0b54352e65ee tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e651017-1fe2-4ee6-8475-1dd10a61706a -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a.f6d82e39-4f07-4494-b7b1-64eafd0f0f7f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:12 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e651017-1fe2-4ee6-8475-1dd10a61706a -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a.f6d82e39-4f07-4494-b7b1-64eafd0f0f7f Jul 06 15:49:12 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:13 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f2681dd2-c553-4277-afd3-39f17acde8b3 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-95c49d33-135b-424f-a4b6-cebfda710a06-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:13 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f2681dd2-c553-4277-afd3-39f17acde8b3 tempest-ProjectMemberTests-765095290 None] Lock "cinder-95c49d33-135b-424f-a4b6-cebfda710a06-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:13 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f2681dd2-c553-4277-afd3-39f17acde8b3 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-quobyte-95c49d33-135b-424f-a4b6-cebfda710a06" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:13 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f2681dd2-c553-4277-afd3-39f17acde8b3 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-95c49d33-135b-424f-a4b6-cebfda710a06" acquired by "delete_volume" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:13 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[d700f16a-4349-4582-b845-887c6431e75c]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f2681dd2-c553-4277-afd3-39f17acde8b3 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:13 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-731a8c46-e73e-4a59-ab0f-0b54352e65ee tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e651017-1fe2-4ee6-8475-1dd10a61706a -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a.f6d82e39-4f07-4494-b7b1-64eafd0f0f7f" returned: 0 in 0.751s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:13 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-731a8c46-e73e-4a59-ab0f-0b54352e65ee tempest-ProjectReaderTests-367541805 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a.f6d82e39-4f07-4494-b7b1-64eafd0f0f7f is being set with open permissions: ugo+rw Jul 06 15:49:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-731a8c46-e73e-4a59-ab0f-0b54352e65ee tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a.f6d82e39-4f07-4494-b7b1-64eafd0f0f7f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:13 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06 Jul 06 15:49:13 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:13 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a.f6d82e39-4f07-4494-b7b1-64eafd0f0f7f Jul 06 15:49:13 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:14 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:14 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f2681dd2-c553-4277-afd3-39f17acde8b3 tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06" returned: 0 in 0.746s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f2681dd2-c553-4277-afd3-39f17acde8b3 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-731a8c46-e73e-4a59-ab0f-0b54352e65ee tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a.f6d82e39-4f07-4494-b7b1-64eafd0f0f7f" returned: 0 in 0.670s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:14 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06 Jul 06 15:49:14 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:14 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-731a8c46-e73e-4a59-ab0f-0b54352e65ee tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:14 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a.info Jul 06 15:49:14 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:15 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-731a8c46-e73e-4a59-ab0f-0b54352e65ee tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a.info" returned: 0 in 0.642s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:15 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-731a8c46-e73e-4a59-ab0f-0b54352e65ee tempest-ProjectReaderTests-367541805 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a.info is being set with open permissions: ugo+rw Jul 06 15:49:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-731a8c46-e73e-4a59-ab0f-0b54352e65ee tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:15 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f2681dd2-c553-4277-afd3-39f17acde8b3 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-95c49d33-135b-424f-a4b6-cebfda710a06" returned: 0 in 0.690s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:15 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a.info Jul 06 15:49:15 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:15 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f2681dd2-c553-4277-afd3-39f17acde8b3 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-95c49d33-135b-424f-a4b6-cebfda710a06" released by "delete_volume" :: held 1.493s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:15 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-f2681dd2-c553-4277-afd3-39f17acde8b3 tempest-ProjectMemberTests-765095290 None] Created reservations ['2f3da230-d779-44e0-ab0a-6ddaaac5b694', 'a1ed0ea4-8266-47de-b2ef-0f16f674984f', 'a42e179a-56b1-4c57-b0d1-871e43a8370a', 'd7f893bf-c12a-4232-8a83-564fd67b2397'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:49:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f2681dd2-c553-4277-afd3-39f17acde8b3 tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f2681dd2-c553-4277-afd3-39f17acde8b3 tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:15 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f2681dd2-c553-4277-afd3-39f17acde8b3 tempest-ProjectMemberTests-765095290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:15 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f2681dd2-c553-4277-afd3-39f17acde8b3 tempest-ProjectMemberTests-765095290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f2681dd2-c553-4277-afd3-39f17acde8b3 tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f2681dd2-c553-4277-afd3-39f17acde8b3 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:15 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:49:15 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:15 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-731a8c46-e73e-4a59-ab0f-0b54352e65ee tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a.info" returned: 0 in 0.652s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-731a8c46-e73e-4a59-ab0f-0b54352e65ee tempest-ProjectReaderTests-367541805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.396s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:15 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-731a8c46-e73e-4a59-ab0f-0b54352e65ee tempest-ProjectReaderTests-367541805 None] Create snapshot completed successfully Jul 06 15:49:15 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:15 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f2681dd2-c553-4277-afd3-39f17acde8b3 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.656s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:15 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-f2681dd2-c553-4277-afd3-39f17acde8b3 tempest-ProjectMemberTests-765095290 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:49:15 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-f2681dd2-c553-4277-afd3-39f17acde8b3 tempest-ProjectMemberTests-765095290 None] Deleted volume successfully. Jul 06 15:49:15 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f2681dd2-c553-4277-afd3-39f17acde8b3 tempest-ProjectMemberTests-765095290 None] Lock "cinder-95c49d33-135b-424f-a4b6-cebfda710a06-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Flow 'volume_create_manager' (870cfc37-339a-40c6-960e-34f2584c1109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693f62fd-fb31-4064-ba48-5a7c30eafd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693f62fd-fb31-4064-ba48-5a7c30eafd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-400632678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a342ab6d-8914-4e66-9518-095b7781be45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2acfd7a95ae04e6a8c97cbd4d6771d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:16Z,use_quota=True,user_id='c8e50c716ff74461bb8f1c33607ef860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d119b1-85a5-42dc-a7c2-4cd39c9bd302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d119b1-85a5-42dc-a7c2-4cd39c9bd302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a43cb83e-e34a-4855-9df8-e55e39b6c8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a43cb83e-e34a-4855-9df8-e55e39b6c8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a342ab6d-8914-4e66-9518-095b7781be45', 'volume_name': 'volume-a342ab6d-8914-4e66-9518-095b7781be45', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df29c00e-1368-43f8-a813-d8b72f5d1908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df29c00e-1368-43f8-a813-d8b72f5d1908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2317791b-9f5b-4def-b780-bd9a77439d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:16 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Volume a342ab6d-8914-4e66-9518-095b7781be45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a342ab6d-8914-4e66-9518-095b7781be45', 'volume_size': 1} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-400632678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a342ab6d-8914-4e66-9518-095b7781be45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2acfd7a95ae04e6a8c97cbd4d6771d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:16Z,use_quota=True,user_id='c8e50c716ff74461bb8f1c33607ef860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Creating volume a342ab6d-8914-4e66-9518-095b7781be45 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:49:16 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:16 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45 1073741824 Jul 06 15:49:16 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8c86ec8c-70a4-4966-be90-4263ddfe889f tempest-ProjectReaderTests-367541805 None] Acquiring lock "cinder-f6d82e39-4f07-4494-b7b1-64eafd0f0f7f-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8c86ec8c-70a4-4966-be90-4263ddfe889f tempest-ProjectReaderTests-367541805 None] Lock "cinder-f6d82e39-4f07-4494-b7b1-64eafd0f0f7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8c86ec8c-70a4-4966-be90-4263ddfe889f tempest-ProjectReaderTests-367541805 None] Acquiring lock "cinder-quobyte-6e651017-1fe2-4ee6-8475-1dd10a61706a" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8c86ec8c-70a4-4966-be90-4263ddfe889f tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-6e651017-1fe2-4ee6-8475-1dd10a61706a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8c86ec8c-70a4-4966-be90-4263ddfe889f tempest-ProjectReaderTests-367541805 None] Acquiring lock "cinder-quobyte-f6d82e39-4f07-4494-b7b1-64eafd0f0f7f" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8c86ec8c-70a4-4966-be90-4263ddfe889f tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-f6d82e39-4f07-4494-b7b1-64eafd0f0f7f" acquired by "_delete_snapshot" :: waited 0.072s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-8c86ec8c-70a4-4966-be90-4263ddfe889f tempest-ProjectReaderTests-367541805 None] Deleting offline snapshot f6d82e39-4f07-4494-b7b1-64eafd0f0f7f of volume 6e651017-1fe2-4ee6-8475-1dd10a61706a {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-8c86ec8c-70a4-4966-be90-4263ddfe889f tempest-ProjectReaderTests-367541805 None] snapshot_file for this snap is: volume-6e651017-1fe2-4ee6-8475-1dd10a61706a.f6d82e39-4f07-4494-b7b1-64eafd0f0f7f {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a49a3cf-0427-4fd3-8941-f64255334ffe]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:16 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8c86ec8c-70a4-4966-be90-4263ddfe889f tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a.f6d82e39-4f07-4494-b7b1-64eafd0f0f7f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:16 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a.f6d82e39-4f07-4494-b7b1-64eafd0f0f7f Jul 06 15:49:16 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:17 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45 1073741824" returned: 0 in 0.810s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:17 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45 Jul 06 15:49:17 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:17 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8c86ec8c-70a4-4966-be90-4263ddfe889f tempest-ProjectReaderTests-367541805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a.f6d82e39-4f07-4494-b7b1-64eafd0f0f7f" returned: 0 in 0.776s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:17 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-8c86ec8c-70a4-4966-be90-4263ddfe889f tempest-ProjectReaderTests-367541805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e651017-1fe2-4ee6-8475-1dd10a61706a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:49:17 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2a1570-f77e-4fd1-a05c-cbf0d202efdc]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8c86ec8c-70a4-4966-be90-4263ddfe889f tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:17 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a Jul 06 15:49:17 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:17 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45" returned: 0 in 0.661s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:17 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:49:17 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:17 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2317791b-9f5b-4def-b780-bd9a77439d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a342ab6d-8914-4e66-9518-095b7781be45', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:17 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e32a82c-e04e-40cb-afbe-39d23120a5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:17 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Volume volume-a342ab6d-8914-4e66-9518-095b7781be45 (a342ab6d-8914-4e66-9518-095b7781be45): created successfully Jul 06 15:49:17 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e32a82c-e04e-40cb-afbe-39d23120a5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:17 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Flow 'volume_create_manager' (870cfc37-339a-40c6-960e-34f2584c1109) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:49:17 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-920dcba0-f1aa-4f0d-af1d-18cc4e90a219 tempest-ProjectMemberTests-765095290 None] Created volume successfully. Jul 06 15:49:18 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8c86ec8c-70a4-4966-be90-4263ddfe889f tempest-ProjectReaderTests-367541805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a" returned: 0 in 0.771s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8c86ec8c-70a4-4966-be90-4263ddfe889f tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a.f6d82e39-4f07-4494-b7b1-64eafd0f0f7f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:18 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a.f6d82e39-4f07-4494-b7b1-64eafd0f0f7f Jul 06 15:49:18 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-de59fda8-c3c2-406b-ae67-8cb6aa92b7a8 tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-de59fda8-c3c2-406b-ae67-8cb6aa92b7a8 tempest-ProjectMemberTests-765095290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:18 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-de59fda8-c3c2-406b-ae67-8cb6aa92b7a8 tempest-ProjectMemberTests-765095290 None] Creating offline snapshot 0dc2ccbb-39ac-4e90-9cce-fe1e08888c3a of volume a342ab6d-8914-4e66-9518-095b7781be45 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:49:18 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19b1b24-f42b-465b-a8e2-3ab608b8d0b7]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-de59fda8-c3c2-406b-ae67-8cb6aa92b7a8 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:18 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45 Jul 06 15:49:18 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:18 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8c86ec8c-70a4-4966-be90-4263ddfe889f tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a.f6d82e39-4f07-4494-b7b1-64eafd0f0f7f" returned: 0 in 0.755s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:18 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8c86ec8c-70a4-4966-be90-4263ddfe889f tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a.f6d82e39-4f07-4494-b7b1-64eafd0f0f7f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:19 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a.f6d82e39-4f07-4494-b7b1-64eafd0f0f7f Jul 06 15:49:19 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:19 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-de59fda8-c3c2-406b-ae67-8cb6aa92b7a8 tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45" returned: 0 in 0.774s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-de59fda8-c3c2-406b-ae67-8cb6aa92b7a8 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45.0dc2ccbb-39ac-4e90-9cce-fe1e08888c3a 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:19 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45.0dc2ccbb-39ac-4e90-9cce-fe1e08888c3a 1G Jul 06 15:49:19 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:19 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:19 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8c86ec8c-70a4-4966-be90-4263ddfe889f tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a.f6d82e39-4f07-4494-b7b1-64eafd0f0f7f" returned: 0 in 0.636s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8c86ec8c-70a4-4966-be90-4263ddfe889f tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-f6d82e39-4f07-4494-b7b1-64eafd0f0f7f" released by "_delete_snapshot" :: held 3.047s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8c86ec8c-70a4-4966-be90-4263ddfe889f tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-6e651017-1fe2-4ee6-8475-1dd10a61706a" released by "delete_snapshot" :: held 3.128s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:19 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-8c86ec8c-70a4-4966-be90-4263ddfe889f tempest-ProjectReaderTests-367541805 None] Created reservations ['5266687d-c58f-4cdd-8cda-a84331b400d2', '6201fa20-a286-4850-8288-a5dc3f4740f5', 'b4cbb155-22eb-4217-9f22-b333addb97ef', '356b75a4-1204-4b0d-bfea-8a94ad9cfd97'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:49:19 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-8c86ec8c-70a4-4966-be90-4263ddfe889f tempest-ProjectReaderTests-367541805 None] Delete snapshot completed successfully. Jul 06 15:49:19 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8c86ec8c-70a4-4966-be90-4263ddfe889f tempest-ProjectReaderTests-367541805 None] Lock "cinder-f6d82e39-4f07-4494-b7b1-64eafd0f0f7f-delete_snapshot" released by "delete_snapshot" :: held 3.260s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:20 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-de59fda8-c3c2-406b-ae67-8cb6aa92b7a8 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45.0dc2ccbb-39ac-4e90-9cce-fe1e08888c3a 1G" returned: 0 in 0.838s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-de59fda8-c3c2-406b-ae67-8cb6aa92b7a8 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a342ab6d-8914-4e66-9518-095b7781be45 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45.0dc2ccbb-39ac-4e90-9cce-fe1e08888c3a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:20 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a342ab6d-8914-4e66-9518-095b7781be45 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45.0dc2ccbb-39ac-4e90-9cce-fe1e08888c3a Jul 06 15:49:20 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:20 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-de59fda8-c3c2-406b-ae67-8cb6aa92b7a8 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a342ab6d-8914-4e66-9518-095b7781be45 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45.0dc2ccbb-39ac-4e90-9cce-fe1e08888c3a" returned: 0 in 0.660s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:20 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-de59fda8-c3c2-406b-ae67-8cb6aa92b7a8 tempest-ProjectMemberTests-765095290 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45.0dc2ccbb-39ac-4e90-9cce-fe1e08888c3a is being set with open permissions: ugo+rw Jul 06 15:49:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-de59fda8-c3c2-406b-ae67-8cb6aa92b7a8 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45.0dc2ccbb-39ac-4e90-9cce-fe1e08888c3a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:20 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45.0dc2ccbb-39ac-4e90-9cce-fe1e08888c3a Jul 06 15:49:20 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:20 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-997691d2-b56b-4440-b348-3e2649abc1f2 tempest-ProjectReaderTests-367541805 None] Acquiring lock "cinder-6e651017-1fe2-4ee6-8475-1dd10a61706a-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:20 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-997691d2-b56b-4440-b348-3e2649abc1f2 tempest-ProjectReaderTests-367541805 None] Lock "cinder-6e651017-1fe2-4ee6-8475-1dd10a61706a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:20 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-997691d2-b56b-4440-b348-3e2649abc1f2 tempest-ProjectReaderTests-367541805 None] Acquiring lock "cinder-quobyte-6e651017-1fe2-4ee6-8475-1dd10a61706a" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:20 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-997691d2-b56b-4440-b348-3e2649abc1f2 tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-6e651017-1fe2-4ee6-8475-1dd10a61706a" acquired by "delete_volume" :: waited 0.015s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:20 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[369e07c2-822e-4586-9db1-2539c599f004]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:20 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-997691d2-b56b-4440-b348-3e2649abc1f2 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:20 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a Jul 06 15:49:20 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:21 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-de59fda8-c3c2-406b-ae67-8cb6aa92b7a8 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45.0dc2ccbb-39ac-4e90-9cce-fe1e08888c3a" returned: 0 in 0.631s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-de59fda8-c3c2-406b-ae67-8cb6aa92b7a8 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:21 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45.info Jul 06 15:49:21 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:21 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-997691d2-b56b-4440-b348-3e2649abc1f2 tempest-ProjectReaderTests-367541805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a" returned: 0 in 0.715s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:21 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-997691d2-b56b-4440-b348-3e2649abc1f2 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:21 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a Jul 06 15:49:21 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:22 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-de59fda8-c3c2-406b-ae67-8cb6aa92b7a8 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45.info" returned: 0 in 0.712s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:22 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-de59fda8-c3c2-406b-ae67-8cb6aa92b7a8 tempest-ProjectMemberTests-765095290 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45.info is being set with open permissions: ugo+rw Jul 06 15:49:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-de59fda8-c3c2-406b-ae67-8cb6aa92b7a8 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:22 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45.info Jul 06 15:49:22 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:22 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-997691d2-b56b-4440-b348-3e2649abc1f2 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-6e651017-1fe2-4ee6-8475-1dd10a61706a" returned: 0 in 0.619s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:22 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-997691d2-b56b-4440-b348-3e2649abc1f2 tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-6e651017-1fe2-4ee6-8475-1dd10a61706a" released by "delete_volume" :: held 1.394s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:22 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-997691d2-b56b-4440-b348-3e2649abc1f2 tempest-ProjectReaderTests-367541805 None] Created reservations ['19df2ea6-9f3d-4d28-9073-2bfe1df51d94', 'a2ee0f15-97ff-40a5-b457-eaba2b904e77', '9f40076c-0311-4bd1-bfd3-8801487d789a', '928e521b-1b2a-47ed-8088-2d6a9bdf38cb'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:49:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-997691d2-b56b-4440-b348-3e2649abc1f2 tempest-ProjectReaderTests-367541805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-997691d2-b56b-4440-b348-3e2649abc1f2 tempest-ProjectReaderTests-367541805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:22 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-997691d2-b56b-4440-b348-3e2649abc1f2 tempest-ProjectReaderTests-367541805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:22 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-997691d2-b56b-4440-b348-3e2649abc1f2 tempest-ProjectReaderTests-367541805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-997691d2-b56b-4440-b348-3e2649abc1f2 tempest-ProjectReaderTests-367541805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-997691d2-b56b-4440-b348-3e2649abc1f2 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:22 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:49:22 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:22 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-de59fda8-c3c2-406b-ae67-8cb6aa92b7a8 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45.info" returned: 0 in 0.695s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-de59fda8-c3c2-406b-ae67-8cb6aa92b7a8 tempest-ProjectMemberTests-765095290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.389s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:22 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-de59fda8-c3c2-406b-ae67-8cb6aa92b7a8 tempest-ProjectMemberTests-765095290 None] Create snapshot completed successfully Jul 06 15:49:22 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:22 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-997691d2-b56b-4440-b348-3e2649abc1f2 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.639s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-997691d2-b56b-4440-b348-3e2649abc1f2 tempest-ProjectReaderTests-367541805 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:49:23 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-997691d2-b56b-4440-b348-3e2649abc1f2 tempest-ProjectReaderTests-367541805 None] Deleted volume successfully. Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-997691d2-b56b-4440-b348-3e2649abc1f2 tempest-ProjectReaderTests-367541805 None] Lock "cinder-6e651017-1fe2-4ee6-8475-1dd10a61706a-delete_volume" released by "delete_volume" :: held 2.238s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Flow 'volume_create_manager' (ee2187cf-0c55-4d6d-a5f8-6525f1c6ef16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd45eaf-bb7a-4609-954d-1eda939741c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd45eaf-bb7a-4609-954d-1eda939741c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-813844758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d4ecdb1-62d0-4120-999b-ac0233ecced7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ef8b6d74c840deb320e6dead13534d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:23Z,use_quota=True,user_id='c05a8530934e4792bd47095b6f6e57b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4038c4-e255-4b89-96be-1b8cf8675e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4038c4-e255-4b89-96be-1b8cf8675e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a01263b-248c-4624-9949-3ebf78513ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a01263b-248c-4624-9949-3ebf78513ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d4ecdb1-62d0-4120-999b-ac0233ecced7', 'volume_name': 'volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e28a9b9f-903c-487f-b25b-b2bf1119b114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e28a9b9f-903c-487f-b25b-b2bf1119b114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab296eab-8e32-4162-b018-e76885713024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:23 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Volume 7d4ecdb1-62d0-4120-999b-ac0233ecced7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7', 'volume_size': 1} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-813844758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d4ecdb1-62d0-4120-999b-ac0233ecced7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ef8b6d74c840deb320e6dead13534d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:23Z,use_quota=True,user_id='c05a8530934e4792bd47095b6f6e57b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Creating volume 7d4ecdb1-62d0-4120-999b-ac0233ecced7 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:49:23 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:23 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7 1073741824 Jul 06 15:49:23 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-776fbc11-0bde-44c9-a41c-f396ba6c1717 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-0dc2ccbb-39ac-4e90-9cce-fe1e08888c3a-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-776fbc11-0bde-44c9-a41c-f396ba6c1717 tempest-ProjectMemberTests-765095290 None] Lock "cinder-0dc2ccbb-39ac-4e90-9cce-fe1e08888c3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-776fbc11-0bde-44c9-a41c-f396ba6c1717 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-quobyte-a342ab6d-8914-4e66-9518-095b7781be45" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-776fbc11-0bde-44c9-a41c-f396ba6c1717 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-a342ab6d-8914-4e66-9518-095b7781be45" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-776fbc11-0bde-44c9-a41c-f396ba6c1717 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-quobyte-0dc2ccbb-39ac-4e90-9cce-fe1e08888c3a" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-776fbc11-0bde-44c9-a41c-f396ba6c1717 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-0dc2ccbb-39ac-4e90-9cce-fe1e08888c3a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-776fbc11-0bde-44c9-a41c-f396ba6c1717 tempest-ProjectMemberTests-765095290 None] Deleting offline snapshot 0dc2ccbb-39ac-4e90-9cce-fe1e08888c3a of volume a342ab6d-8914-4e66-9518-095b7781be45 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-776fbc11-0bde-44c9-a41c-f396ba6c1717 tempest-ProjectMemberTests-765095290 None] snapshot_file for this snap is: volume-a342ab6d-8914-4e66-9518-095b7781be45.0dc2ccbb-39ac-4e90-9cce-fe1e08888c3a {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a05dade-9592-4b13-835a-bd6af6f5a4dc]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:23 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-776fbc11-0bde-44c9-a41c-f396ba6c1717 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45.0dc2ccbb-39ac-4e90-9cce-fe1e08888c3a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:23 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45.0dc2ccbb-39ac-4e90-9cce-fe1e08888c3a Jul 06 15:49:23 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:24 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7 1073741824" returned: 0 in 0.791s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:24 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7 Jul 06 15:49:24 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:24 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-776fbc11-0bde-44c9-a41c-f396ba6c1717 tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45.0dc2ccbb-39ac-4e90-9cce-fe1e08888c3a" returned: 0 in 0.777s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-776fbc11-0bde-44c9-a41c-f396ba6c1717 tempest-ProjectMemberTests-765095290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a342ab6d-8914-4e66-9518-095b7781be45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:49:24 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d91f6a4-f4ae-443e-9227-fc9f55ecd96f]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-776fbc11-0bde-44c9-a41c-f396ba6c1717 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:24 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45 Jul 06 15:49:24 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:24 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7" returned: 0 in 0.659s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:24 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:49:24 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:25 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab296eab-8e32-4162-b018-e76885713024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:25 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2379d585-25a4-40af-98a2-826821a22a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:25 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Volume volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7 (7d4ecdb1-62d0-4120-999b-ac0233ecced7): created successfully Jul 06 15:49:25 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2379d585-25a4-40af-98a2-826821a22a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:25 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Flow 'volume_create_manager' (ee2187cf-0c55-4d6d-a5f8-6525f1c6ef16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:49:25 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-222ea756-b4d6-45ed-b226-40d5156d31f2 tempest-ProjectReaderTests-367541805 None] Created volume successfully. Jul 06 15:49:25 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-776fbc11-0bde-44c9-a41c-f396ba6c1717 tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45" returned: 0 in 0.755s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-776fbc11-0bde-44c9-a41c-f396ba6c1717 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45.0dc2ccbb-39ac-4e90-9cce-fe1e08888c3a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:25 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45.0dc2ccbb-39ac-4e90-9cce-fe1e08888c3a Jul 06 15:49:25 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8cf036bf-c7f7-4044-a3aa-f354f83501c5 tempest-ProjectReaderTests-367541805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8cf036bf-c7f7-4044-a3aa-f354f83501c5 tempest-ProjectReaderTests-367541805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:25 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-8cf036bf-c7f7-4044-a3aa-f354f83501c5 tempest-ProjectReaderTests-367541805 None] Creating offline snapshot 94082949-b2c3-4c49-bebd-ab3aebc3b492 of volume 7d4ecdb1-62d0-4120-999b-ac0233ecced7 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:49:25 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f432c7e-843a-4639-82e3-541432ad5b97]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:25 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8cf036bf-c7f7-4044-a3aa-f354f83501c5 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:25 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7 Jul 06 15:49:25 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:26 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-776fbc11-0bde-44c9-a41c-f396ba6c1717 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45.0dc2ccbb-39ac-4e90-9cce-fe1e08888c3a" returned: 0 in 0.754s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-776fbc11-0bde-44c9-a41c-f396ba6c1717 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45.0dc2ccbb-39ac-4e90-9cce-fe1e08888c3a {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:26 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45.0dc2ccbb-39ac-4e90-9cce-fe1e08888c3a Jul 06 15:49:26 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:26 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8cf036bf-c7f7-4044-a3aa-f354f83501c5 tempest-ProjectReaderTests-367541805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7" returned: 0 in 0.752s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8cf036bf-c7f7-4044-a3aa-f354f83501c5 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7.94082949-b2c3-4c49-bebd-ab3aebc3b492 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:26 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7.94082949-b2c3-4c49-bebd-ab3aebc3b492 1G Jul 06 15:49:26 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:26 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:26 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-776fbc11-0bde-44c9-a41c-f396ba6c1717 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45.0dc2ccbb-39ac-4e90-9cce-fe1e08888c3a" returned: 0 in 0.614s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-776fbc11-0bde-44c9-a41c-f396ba6c1717 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-0dc2ccbb-39ac-4e90-9cce-fe1e08888c3a" released by "_delete_snapshot" :: held 3.003s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-776fbc11-0bde-44c9-a41c-f396ba6c1717 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-a342ab6d-8914-4e66-9518-095b7781be45" released by "delete_snapshot" :: held 3.029s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:26 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-776fbc11-0bde-44c9-a41c-f396ba6c1717 tempest-ProjectMemberTests-765095290 None] Created reservations ['c49486d1-15fc-4acd-a817-c4f7047d4053', '426d7fac-86c4-4109-bcdb-79f4945132ec', 'cf632278-a1af-4242-8f4f-5108569b8a91', '80f37ca7-87df-40ae-8b09-bb5526d8cfcc'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:49:26 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-776fbc11-0bde-44c9-a41c-f396ba6c1717 tempest-ProjectMemberTests-765095290 None] Delete snapshot completed successfully. Jul 06 15:49:26 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-776fbc11-0bde-44c9-a41c-f396ba6c1717 tempest-ProjectMemberTests-765095290 None] Lock "cinder-0dc2ccbb-39ac-4e90-9cce-fe1e08888c3a-delete_snapshot" released by "delete_snapshot" :: held 3.173s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:27 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8cf036bf-c7f7-4044-a3aa-f354f83501c5 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7.94082949-b2c3-4c49-bebd-ab3aebc3b492 1G" returned: 0 in 0.746s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8cf036bf-c7f7-4044-a3aa-f354f83501c5 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7.94082949-b2c3-4c49-bebd-ab3aebc3b492 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:27 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7.94082949-b2c3-4c49-bebd-ab3aebc3b492 Jul 06 15:49:27 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:27 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8cf036bf-c7f7-4044-a3aa-f354f83501c5 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7.94082949-b2c3-4c49-bebd-ab3aebc3b492" returned: 0 in 0.659s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:27 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-8cf036bf-c7f7-4044-a3aa-f354f83501c5 tempest-ProjectReaderTests-367541805 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7.94082949-b2c3-4c49-bebd-ab3aebc3b492 is being set with open permissions: ugo+rw Jul 06 15:49:27 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8cf036bf-c7f7-4044-a3aa-f354f83501c5 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7.94082949-b2c3-4c49-bebd-ab3aebc3b492 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:27 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8fe16c13-f3a8-4a7f-b304-9864434ac795 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-a342ab6d-8914-4e66-9518-095b7781be45-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:27 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7.94082949-b2c3-4c49-bebd-ab3aebc3b492 Jul 06 15:49:27 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:27 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8fe16c13-f3a8-4a7f-b304-9864434ac795 tempest-ProjectMemberTests-765095290 None] Lock "cinder-a342ab6d-8914-4e66-9518-095b7781be45-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:27 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8fe16c13-f3a8-4a7f-b304-9864434ac795 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-quobyte-a342ab6d-8914-4e66-9518-095b7781be45" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:27 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8fe16c13-f3a8-4a7f-b304-9864434ac795 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-a342ab6d-8914-4e66-9518-095b7781be45" acquired by "delete_volume" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:28 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[193ca9bf-79bf-438a-85b6-b7888a103b6f]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8fe16c13-f3a8-4a7f-b304-9864434ac795 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:28 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45 Jul 06 15:49:28 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:28 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8cf036bf-c7f7-4044-a3aa-f354f83501c5 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7.94082949-b2c3-4c49-bebd-ab3aebc3b492" returned: 0 in 0.625s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8cf036bf-c7f7-4044-a3aa-f354f83501c5 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:28 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7.info Jul 06 15:49:28 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:28 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8fe16c13-f3a8-4a7f-b304-9864434ac795 tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45" returned: 0 in 0.724s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:28 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8fe16c13-f3a8-4a7f-b304-9864434ac795 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:28 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45 Jul 06 15:49:28 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:29 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8cf036bf-c7f7-4044-a3aa-f354f83501c5 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7.info" returned: 0 in 0.613s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:29 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-8cf036bf-c7f7-4044-a3aa-f354f83501c5 tempest-ProjectReaderTests-367541805 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7.info is being set with open permissions: ugo+rw Jul 06 15:49:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8cf036bf-c7f7-4044-a3aa-f354f83501c5 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:29 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7.info Jul 06 15:49:29 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:29 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8fe16c13-f3a8-4a7f-b304-9864434ac795 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-a342ab6d-8914-4e66-9518-095b7781be45" returned: 0 in 0.628s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8fe16c13-f3a8-4a7f-b304-9864434ac795 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-a342ab6d-8914-4e66-9518-095b7781be45" released by "delete_volume" :: held 1.407s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:29 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-8fe16c13-f3a8-4a7f-b304-9864434ac795 tempest-ProjectMemberTests-765095290 None] Created reservations ['05d84a45-4e5e-427b-9720-ba9c5b68ce7f', 'eb0bb1e5-af06-41e6-9d77-7ce7b9804848', '701f9a29-6d4b-41e8-baff-09ef737fb3aa', '09e12e6d-ab18-4748-b187-98fd57a6df2b'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:49:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8fe16c13-f3a8-4a7f-b304-9864434ac795 tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8fe16c13-f3a8-4a7f-b304-9864434ac795 tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:29 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-8fe16c13-f3a8-4a7f-b304-9864434ac795 tempest-ProjectMemberTests-765095290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:29 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-8fe16c13-f3a8-4a7f-b304-9864434ac795 tempest-ProjectMemberTests-765095290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8fe16c13-f3a8-4a7f-b304-9864434ac795 tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8fe16c13-f3a8-4a7f-b304-9864434ac795 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:29 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:49:29 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:29 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8cf036bf-c7f7-4044-a3aa-f354f83501c5 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7.info" returned: 0 in 0.612s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:29 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-8cf036bf-c7f7-4044-a3aa-f354f83501c5 tempest-ProjectReaderTests-367541805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.078s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:29 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-8cf036bf-c7f7-4044-a3aa-f354f83501c5 tempest-ProjectReaderTests-367541805 None] Create snapshot completed successfully Jul 06 15:49:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-35fdd4b5-dcaf-45bd-b291-1e63ff0522b7 tempest-ProjectReaderTests-367541805 None] Acquiring lock "cinder-94082949-b2c3-4c49-bebd-ab3aebc3b492-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-35fdd4b5-dcaf-45bd-b291-1e63ff0522b7 tempest-ProjectReaderTests-367541805 None] Lock "cinder-94082949-b2c3-4c49-bebd-ab3aebc3b492-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-35fdd4b5-dcaf-45bd-b291-1e63ff0522b7 tempest-ProjectReaderTests-367541805 None] Acquiring lock "cinder-quobyte-7d4ecdb1-62d0-4120-999b-ac0233ecced7" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-35fdd4b5-dcaf-45bd-b291-1e63ff0522b7 tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-7d4ecdb1-62d0-4120-999b-ac0233ecced7" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-35fdd4b5-dcaf-45bd-b291-1e63ff0522b7 tempest-ProjectReaderTests-367541805 None] Acquiring lock "cinder-quobyte-94082949-b2c3-4c49-bebd-ab3aebc3b492" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:29 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-35fdd4b5-dcaf-45bd-b291-1e63ff0522b7 tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-94082949-b2c3-4c49-bebd-ab3aebc3b492" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:29 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-35fdd4b5-dcaf-45bd-b291-1e63ff0522b7 tempest-ProjectReaderTests-367541805 None] Deleting offline snapshot 94082949-b2c3-4c49-bebd-ab3aebc3b492 of volume 7d4ecdb1-62d0-4120-999b-ac0233ecced7 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-35fdd4b5-dcaf-45bd-b291-1e63ff0522b7 tempest-ProjectReaderTests-367541805 None] snapshot_file for this snap is: volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7.94082949-b2c3-4c49-bebd-ab3aebc3b492 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99a8408-3330-4d1d-bfba-fe0e957608f1]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-35fdd4b5-dcaf-45bd-b291-1e63ff0522b7 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7.94082949-b2c3-4c49-bebd-ab3aebc3b492 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:30 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7.94082949-b2c3-4c49-bebd-ab3aebc3b492 Jul 06 15:49:30 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:30 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-8fe16c13-f3a8-4a7f-b304-9864434ac795 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.683s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-8fe16c13-f3a8-4a7f-b304-9864434ac795 tempest-ProjectMemberTests-765095290 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:49:30 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-8fe16c13-f3a8-4a7f-b304-9864434ac795 tempest-ProjectMemberTests-765095290 None] Deleted volume successfully. Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-8fe16c13-f3a8-4a7f-b304-9864434ac795 tempest-ProjectMemberTests-765095290 None] Lock "cinder-a342ab6d-8914-4e66-9518-095b7781be45-delete_volume" released by "delete_volume" :: held 2.298s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Flow 'volume_create_manager' (c0290c3b-e998-47e0-a5f6-0ffcb6e3467a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6a3a5d-f144-4146-ae6a-c6cb138f183d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6a3a5d-f144-4146-ae6a-c6cb138f183d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-878775506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a2caf3-8d18-4cf9-a244-43a7181bac34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2acfd7a95ae04e6a8c97cbd4d6771d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:31Z,use_quota=True,user_id='c8e50c716ff74461bb8f1c33607ef860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3bfcfc0-b2c3-4a7d-9814-4abab62e26f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3bfcfc0-b2c3-4a7d-9814-4abab62e26f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276f69d3-7835-4748-8283-15f5941a03c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276f69d3-7835-4748-8283-15f5941a03c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31a2caf3-8d18-4cf9-a244-43a7181bac34', 'volume_name': 'volume-31a2caf3-8d18-4cf9-a244-43a7181bac34', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af038330-84e5-4086-a71d-a43406c33733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af038330-84e5-4086-a71d-a43406c33733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11f06db-9dcb-42de-953a-201da3f4848f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:30 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Volume 31a2caf3-8d18-4cf9-a244-43a7181bac34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31a2caf3-8d18-4cf9-a244-43a7181bac34', 'volume_size': 1} Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-878775506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a2caf3-8d18-4cf9-a244-43a7181bac34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2acfd7a95ae04e6a8c97cbd4d6771d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:31Z,use_quota=True,user_id='c8e50c716ff74461bb8f1c33607ef860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Creating volume 31a2caf3-8d18-4cf9-a244-43a7181bac34 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:49:30 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:30 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34 1073741824 Jul 06 15:49:30 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:30 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-35fdd4b5-dcaf-45bd-b291-1e63ff0522b7 tempest-ProjectReaderTests-367541805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7.94082949-b2c3-4c49-bebd-ab3aebc3b492" returned: 0 in 0.774s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-35fdd4b5-dcaf-45bd-b291-1e63ff0522b7 tempest-ProjectReaderTests-367541805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75a6f0a-b8c4-4e91-9955-8a6d720bc957]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:30 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-35fdd4b5-dcaf-45bd-b291-1e63ff0522b7 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:30 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7 Jul 06 15:49:30 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:31 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-35fdd4b5-dcaf-45bd-b291-1e63ff0522b7 tempest-ProjectReaderTests-367541805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7" returned: 0 in 0.720s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-35fdd4b5-dcaf-45bd-b291-1e63ff0522b7 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7.94082949-b2c3-4c49-bebd-ab3aebc3b492 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:31 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34 1073741824" returned: 0 in 0.854s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:31 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7.94082949-b2c3-4c49-bebd-ab3aebc3b492 Jul 06 15:49:31 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:31 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:31 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34 Jul 06 15:49:31 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:32 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34" returned: 0 in 0.674s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:32 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:49:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11f06db-9dcb-42de-953a-201da3f4848f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31a2caf3-8d18-4cf9-a244-43a7181bac34', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d3f50f-d362-4e81-8604-afd0e9369fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:32 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-35fdd4b5-dcaf-45bd-b291-1e63ff0522b7 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7.94082949-b2c3-4c49-bebd-ab3aebc3b492" returned: 0 in 0.760s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-35fdd4b5-dcaf-45bd-b291-1e63ff0522b7 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7.94082949-b2c3-4c49-bebd-ab3aebc3b492 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:32 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Volume volume-31a2caf3-8d18-4cf9-a244-43a7181bac34 (31a2caf3-8d18-4cf9-a244-43a7181bac34): created successfully Jul 06 15:49:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d3f50f-d362-4e81-8604-afd0e9369fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:32 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Flow 'volume_create_manager' (c0290c3b-e998-47e0-a5f6-0ffcb6e3467a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:49:32 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7.94082949-b2c3-4c49-bebd-ab3aebc3b492 Jul 06 15:49:32 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:32 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-5e6a5149-deb2-4ced-9f84-642434ddd7fa tempest-ProjectMemberTests-765095290 None] Created volume successfully. Jul 06 15:49:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9aad4256-029c-4ab6-9033-c4edea4b843c tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9aad4256-029c-4ab6-9033-c4edea4b843c tempest-ProjectMemberTests-765095290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:32 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-9aad4256-029c-4ab6-9033-c4edea4b843c tempest-ProjectMemberTests-765095290 None] Creating offline snapshot 83c81acf-cff6-48c7-baa5-ee5ff5f421ae of volume 31a2caf3-8d18-4cf9-a244-43a7181bac34 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:49:32 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[21aa2b47-42ba-4b66-a56e-4a625520b56e]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9aad4256-029c-4ab6-9033-c4edea4b843c tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:32 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:32 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-35fdd4b5-dcaf-45bd-b291-1e63ff0522b7 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7.94082949-b2c3-4c49-bebd-ab3aebc3b492" returned: 0 in 0.659s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:32 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-35fdd4b5-dcaf-45bd-b291-1e63ff0522b7 tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-94082949-b2c3-4c49-bebd-ab3aebc3b492" released by "_delete_snapshot" :: held 3.008s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:33 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-35fdd4b5-dcaf-45bd-b291-1e63ff0522b7 tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-7d4ecdb1-62d0-4120-999b-ac0233ecced7" released by "delete_snapshot" :: held 3.031s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:33 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34 Jul 06 15:49:33 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:33 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-35fdd4b5-dcaf-45bd-b291-1e63ff0522b7 tempest-ProjectReaderTests-367541805 None] Created reservations ['c7c34c47-6b42-4ac1-a811-809d9be4b204', 'a9842192-56b1-4041-bb90-8507bc1d187e', '2696b15f-14b9-4ec9-851d-eb1ddbf8fac0', '1a1792bd-cdac-4389-a4ff-fde2831a405d'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:49:33 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-35fdd4b5-dcaf-45bd-b291-1e63ff0522b7 tempest-ProjectReaderTests-367541805 None] Delete snapshot completed successfully. Jul 06 15:49:33 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-35fdd4b5-dcaf-45bd-b291-1e63ff0522b7 tempest-ProjectReaderTests-367541805 None] Lock "cinder-94082949-b2c3-4c49-bebd-ab3aebc3b492-delete_snapshot" released by "delete_snapshot" :: held 3.190s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:33 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9aad4256-029c-4ab6-9033-c4edea4b843c tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34" returned: 0 in 0.829s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:33 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9aad4256-029c-4ab6-9033-c4edea4b843c tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34.83c81acf-cff6-48c7-baa5-ee5ff5f421ae 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:33 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34.83c81acf-cff6-48c7-baa5-ee5ff5f421ae 1G Jul 06 15:49:33 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:34 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-10482e69-61a7-42b1-8b51-cc671d797e31 tempest-ProjectReaderTests-367541805 None] Acquiring lock "cinder-7d4ecdb1-62d0-4120-999b-ac0233ecced7-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:34 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-10482e69-61a7-42b1-8b51-cc671d797e31 tempest-ProjectReaderTests-367541805 None] Lock "cinder-7d4ecdb1-62d0-4120-999b-ac0233ecced7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:34 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-10482e69-61a7-42b1-8b51-cc671d797e31 tempest-ProjectReaderTests-367541805 None] Acquiring lock "cinder-quobyte-7d4ecdb1-62d0-4120-999b-ac0233ecced7" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:34 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-10482e69-61a7-42b1-8b51-cc671d797e31 tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-7d4ecdb1-62d0-4120-999b-ac0233ecced7" acquired by "delete_volume" :: waited 0.021s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:34 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[51348cbb-bbd5-4de5-ab46-1df8f0c95f05]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-10482e69-61a7-42b1-8b51-cc671d797e31 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:34 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7 Jul 06 15:49:34 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:34 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9aad4256-029c-4ab6-9033-c4edea4b843c tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34.83c81acf-cff6-48c7-baa5-ee5ff5f421ae 1G" returned: 0 in 0.807s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:34 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9aad4256-029c-4ab6-9033-c4edea4b843c tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31a2caf3-8d18-4cf9-a244-43a7181bac34 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34.83c81acf-cff6-48c7-baa5-ee5ff5f421ae {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:34 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31a2caf3-8d18-4cf9-a244-43a7181bac34 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34.83c81acf-cff6-48c7-baa5-ee5ff5f421ae Jul 06 15:49:34 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:35 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-10482e69-61a7-42b1-8b51-cc671d797e31 tempest-ProjectReaderTests-367541805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7" returned: 0 in 0.784s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-10482e69-61a7-42b1-8b51-cc671d797e31 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:35 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7 Jul 06 15:49:35 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:35 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9aad4256-029c-4ab6-9033-c4edea4b843c tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31a2caf3-8d18-4cf9-a244-43a7181bac34 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34.83c81acf-cff6-48c7-baa5-ee5ff5f421ae" returned: 0 in 0.747s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:35 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-9aad4256-029c-4ab6-9033-c4edea4b843c tempest-ProjectMemberTests-765095290 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34.83c81acf-cff6-48c7-baa5-ee5ff5f421ae is being set with open permissions: ugo+rw Jul 06 15:49:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9aad4256-029c-4ab6-9033-c4edea4b843c tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34.83c81acf-cff6-48c7-baa5-ee5ff5f421ae {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:35 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34.83c81acf-cff6-48c7-baa5-ee5ff5f421ae Jul 06 15:49:35 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:35 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-10482e69-61a7-42b1-8b51-cc671d797e31 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-7d4ecdb1-62d0-4120-999b-ac0233ecced7" returned: 0 in 0.648s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:35 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-10482e69-61a7-42b1-8b51-cc671d797e31 tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-7d4ecdb1-62d0-4120-999b-ac0233ecced7" released by "delete_volume" :: held 1.505s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:35 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-10482e69-61a7-42b1-8b51-cc671d797e31 tempest-ProjectReaderTests-367541805 None] Created reservations ['277d35cb-fca1-4bc0-95f7-9a1aefedb236', '5cd49c31-178a-4c32-9f50-26000d1df12d', 'a866f9a9-f658-408a-9f52-ccf6d07d5c8a', '2e60bd1e-bd98-43c9-966d-0f4c0ccb8409'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:49:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-10482e69-61a7-42b1-8b51-cc671d797e31 tempest-ProjectReaderTests-367541805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-10482e69-61a7-42b1-8b51-cc671d797e31 tempest-ProjectReaderTests-367541805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:35 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-10482e69-61a7-42b1-8b51-cc671d797e31 tempest-ProjectReaderTests-367541805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:35 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-10482e69-61a7-42b1-8b51-cc671d797e31 tempest-ProjectReaderTests-367541805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-10482e69-61a7-42b1-8b51-cc671d797e31 tempest-ProjectReaderTests-367541805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-10482e69-61a7-42b1-8b51-cc671d797e31 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:35 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:49:35 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:35 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:35 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9aad4256-029c-4ab6-9033-c4edea4b843c tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34.83c81acf-cff6-48c7-baa5-ee5ff5f421ae" returned: 0 in 0.675s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9aad4256-029c-4ab6-9033-c4edea4b843c tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:36 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34.info Jul 06 15:49:36 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:36 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-10482e69-61a7-42b1-8b51-cc671d797e31 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.655s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:36 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-10482e69-61a7-42b1-8b51-cc671d797e31 tempest-ProjectReaderTests-367541805 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:49:36 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-10482e69-61a7-42b1-8b51-cc671d797e31 tempest-ProjectReaderTests-367541805 None] Deleted volume successfully. Jul 06 15:49:36 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-10482e69-61a7-42b1-8b51-cc671d797e31 tempest-ProjectReaderTests-367541805 None] Lock "cinder-7d4ecdb1-62d0-4120-999b-ac0233ecced7-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:36 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9aad4256-029c-4ab6-9033-c4edea4b843c tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34.info" returned: 0 in 0.684s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:36 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-9aad4256-029c-4ab6-9033-c4edea4b843c tempest-ProjectMemberTests-765095290 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34.info is being set with open permissions: ugo+rw Jul 06 15:49:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9aad4256-029c-4ab6-9033-c4edea4b843c tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:36 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34.info Jul 06 15:49:36 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:36 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:49:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Flow 'volume_create_manager' (484933df-cad6-4ab2-b191-d984a35116ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:49:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30a91be6-da74-41cf-aaf9-8e8fb661c3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30a91be6-da74-41cf-aaf9-8e8fb661c3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-146096800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=170be4d8-aa86-4977-9f6e-1f96f9f247b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ef8b6d74c840deb320e6dead13534d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:37Z,use_quota=True,user_id='c05a8530934e4792bd47095b6f6e57b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb6dd50d-649c-4ba8-abf9-f9e1c666541f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb6dd50d-649c-4ba8-abf9-f9e1c666541f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b280611-ab3c-4302-9d82-713b99448fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b280611-ab3c-4302-9d82-713b99448fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '170be4d8-aa86-4977-9f6e-1f96f9f247b2', 'volume_name': 'volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b1ee8de-195b-48c5-b5f5-c07fd730ef6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b1ee8de-195b-48c5-b5f5-c07fd730ef6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:36 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd712fd-62e4-430d-9cb8-41f23150a594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:36 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Volume 170be4d8-aa86-4977-9f6e-1f96f9f247b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2', 'volume_size': 1} Jul 06 15:49:36 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:37 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-9aad4256-029c-4ab6-9033-c4edea4b843c tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34.info" returned: 0 in 0.643s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-9aad4256-029c-4ab6-9033-c4edea4b843c tempest-ProjectMemberTests-765095290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.473s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.403s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-146096800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=170be4d8-aa86-4977-9f6e-1f96f9f247b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ef8b6d74c840deb320e6dead13534d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:37Z,use_quota=True,user_id='c05a8530934e4792bd47095b6f6e57b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:49:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Creating volume 170be4d8-aa86-4977-9f6e-1f96f9f247b2 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:49:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:37 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:49:37 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:49:37 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:37 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2 1073741824 Jul 06 15:49:37 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:37 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-9aad4256-029c-4ab6-9033-c4edea4b843c tempest-ProjectMemberTests-765095290 None] Create snapshot completed successfully Jul 06 15:49:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4c53bfeb-ddad-4b93-9e3a-3a7ae99f20df tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-83c81acf-cff6-48c7-baa5-ee5ff5f421ae-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4c53bfeb-ddad-4b93-9e3a-3a7ae99f20df tempest-ProjectMemberTests-765095290 None] Lock "cinder-83c81acf-cff6-48c7-baa5-ee5ff5f421ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4c53bfeb-ddad-4b93-9e3a-3a7ae99f20df tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-quobyte-31a2caf3-8d18-4cf9-a244-43a7181bac34" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4c53bfeb-ddad-4b93-9e3a-3a7ae99f20df tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-31a2caf3-8d18-4cf9-a244-43a7181bac34" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4c53bfeb-ddad-4b93-9e3a-3a7ae99f20df tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-quobyte-83c81acf-cff6-48c7-baa5-ee5ff5f421ae" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:38 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4c53bfeb-ddad-4b93-9e3a-3a7ae99f20df tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-83c81acf-cff6-48c7-baa5-ee5ff5f421ae" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-4c53bfeb-ddad-4b93-9e3a-3a7ae99f20df tempest-ProjectMemberTests-765095290 None] Deleting offline snapshot 83c81acf-cff6-48c7-baa5-ee5ff5f421ae of volume 31a2caf3-8d18-4cf9-a244-43a7181bac34 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:49:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-4c53bfeb-ddad-4b93-9e3a-3a7ae99f20df tempest-ProjectMemberTests-765095290 None] snapshot_file for this snap is: volume-31a2caf3-8d18-4cf9-a244-43a7181bac34.83c81acf-cff6-48c7-baa5-ee5ff5f421ae {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:49:38 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[8175b088-44b5-49e4-b822-d3ae65093d39]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4c53bfeb-ddad-4b93-9e3a-3a7ae99f20df tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34.83c81acf-cff6-48c7-baa5-ee5ff5f421ae {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:38 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2 1073741824" returned: 0 in 0.890s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:38 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34.83c81acf-cff6-48c7-baa5-ee5ff5f421ae Jul 06 15:49:38 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:38 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2 Jul 06 15:49:38 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:49:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:38 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:49:38 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:39 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2" returned: 0 in 0.709s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:39 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:49:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd712fd-62e4-430d-9cb8-41f23150a594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:39 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a9ca1d0-0854-4d73-8466-8c53760c4c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4c53bfeb-ddad-4b93-9e3a-3a7ae99f20df tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34.83c81acf-cff6-48c7-baa5-ee5ff5f421ae" returned: 0 in 0.846s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:39 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-4c53bfeb-ddad-4b93-9e3a-3a7ae99f20df tempest-ProjectMemberTests-765095290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31a2caf3-8d18-4cf9-a244-43a7181bac34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:49:39 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[da456bc7-d482-4e4c-a27b-ce3a8de7b201]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4c53bfeb-ddad-4b93-9e3a-3a7ae99f20df tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:39 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Volume volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2 (170be4d8-aa86-4977-9f6e-1f96f9f247b2): created successfully Jul 06 15:49:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a9ca1d0-0854-4d73-8466-8c53760c4c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Flow 'volume_create_manager' (484933df-cad6-4ab2-b191-d984a35116ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:49:39 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-83b5f07e-51d3-41c9-81af-009158522ca0 tempest-ProjectReaderTests-367541805 None] Created volume successfully. Jul 06 15:49:39 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34 Jul 06 15:49:39 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:39 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.711s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:49:39 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager._thread_info {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:49:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread count: 28 {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:49:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread info: [<_MainThread(MainThread, started 124857273856128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:49:39 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4c53bfeb-ddad-4b93-9e3a-3a7ae99f20df tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34" returned: 0 in 0.803s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4c53bfeb-ddad-4b93-9e3a-3a7ae99f20df tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34.83c81acf-cff6-48c7-baa5-ee5ff5f421ae {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:39 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34.83c81acf-cff6-48c7-baa5-ee5ff5f421ae Jul 06 15:49:39 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1f6128ae-c937-414f-bf36-bbc8ee56c6f3 tempest-ProjectReaderTests-367541805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1f6128ae-c937-414f-bf36-bbc8ee56c6f3 tempest-ProjectReaderTests-367541805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-1f6128ae-c937-414f-bf36-bbc8ee56c6f3 tempest-ProjectReaderTests-367541805 None] Creating offline snapshot 752c2bd9-fd2f-4f5f-a310-64b4ade7f1f1 of volume 170be4d8-aa86-4977-9f6e-1f96f9f247b2 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:49:40 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cbb701-16d1-4eb0-a723-2f33559f9d38]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1f6128ae-c937-414f-bf36-bbc8ee56c6f3 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:40 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2 Jul 06 15:49:40 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:40 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4c53bfeb-ddad-4b93-9e3a-3a7ae99f20df tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34.83c81acf-cff6-48c7-baa5-ee5ff5f421ae" returned: 0 in 0.749s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4c53bfeb-ddad-4b93-9e3a-3a7ae99f20df tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34.83c81acf-cff6-48c7-baa5-ee5ff5f421ae {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:40 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34.83c81acf-cff6-48c7-baa5-ee5ff5f421ae Jul 06 15:49:40 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:41 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1f6128ae-c937-414f-bf36-bbc8ee56c6f3 tempest-ProjectReaderTests-367541805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2" returned: 0 in 0.824s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1f6128ae-c937-414f-bf36-bbc8ee56c6f3 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2.752c2bd9-fd2f-4f5f-a310-64b4ade7f1f1 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:41 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2.752c2bd9-fd2f-4f5f-a310-64b4ade7f1f1 1G Jul 06 15:49:41 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:41 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4c53bfeb-ddad-4b93-9e3a-3a7ae99f20df tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34.83c81acf-cff6-48c7-baa5-ee5ff5f421ae" returned: 0 in 0.734s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4c53bfeb-ddad-4b93-9e3a-3a7ae99f20df tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-83c81acf-cff6-48c7-baa5-ee5ff5f421ae" released by "_delete_snapshot" :: held 3.251s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4c53bfeb-ddad-4b93-9e3a-3a7ae99f20df tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-31a2caf3-8d18-4cf9-a244-43a7181bac34" released by "delete_snapshot" :: held 3.271s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:41 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-4c53bfeb-ddad-4b93-9e3a-3a7ae99f20df tempest-ProjectMemberTests-765095290 None] Created reservations ['57890e43-0346-4fc0-912b-f57caa89ba72', '6fb12617-515f-4092-88c5-c5a831af8fca', '8dcae9b2-c958-4a08-8f29-bcf15d3e6bbe', 'ebd67c92-9143-43cf-aa5b-14460d5b75cd'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:49:41 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-4c53bfeb-ddad-4b93-9e3a-3a7ae99f20df tempest-ProjectMemberTests-765095290 None] Delete snapshot completed successfully. Jul 06 15:49:41 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4c53bfeb-ddad-4b93-9e3a-3a7ae99f20df tempest-ProjectMemberTests-765095290 None] Lock "cinder-83c81acf-cff6-48c7-baa5-ee5ff5f421ae-delete_snapshot" released by "delete_snapshot" :: held 3.429s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:41 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1f6128ae-c937-414f-bf36-bbc8ee56c6f3 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2.752c2bd9-fd2f-4f5f-a310-64b4ade7f1f1 1G" returned: 0 in 0.849s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1f6128ae-c937-414f-bf36-bbc8ee56c6f3 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2.752c2bd9-fd2f-4f5f-a310-64b4ade7f1f1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:41 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2.752c2bd9-fd2f-4f5f-a310-64b4ade7f1f1 Jul 06 15:49:41 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:42 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5ac0b7f2-75bd-4813-bafc-121b92cd99ee tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-31a2caf3-8d18-4cf9-a244-43a7181bac34-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:42 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5ac0b7f2-75bd-4813-bafc-121b92cd99ee tempest-ProjectMemberTests-765095290 None] Lock "cinder-31a2caf3-8d18-4cf9-a244-43a7181bac34-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:42 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5ac0b7f2-75bd-4813-bafc-121b92cd99ee tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-quobyte-31a2caf3-8d18-4cf9-a244-43a7181bac34" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:42 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5ac0b7f2-75bd-4813-bafc-121b92cd99ee tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-31a2caf3-8d18-4cf9-a244-43a7181bac34" acquired by "delete_volume" :: waited 0.016s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:42 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[704f9cb5-91c3-4343-a99f-bfeedafec2fb]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5ac0b7f2-75bd-4813-bafc-121b92cd99ee tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:42 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34 Jul 06 15:49:42 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:42 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1f6128ae-c937-414f-bf36-bbc8ee56c6f3 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2.752c2bd9-fd2f-4f5f-a310-64b4ade7f1f1" returned: 0 in 0.729s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:42 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-1f6128ae-c937-414f-bf36-bbc8ee56c6f3 tempest-ProjectReaderTests-367541805 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2.752c2bd9-fd2f-4f5f-a310-64b4ade7f1f1 is being set with open permissions: ugo+rw Jul 06 15:49:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1f6128ae-c937-414f-bf36-bbc8ee56c6f3 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2.752c2bd9-fd2f-4f5f-a310-64b4ade7f1f1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:42 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2.752c2bd9-fd2f-4f5f-a310-64b4ade7f1f1 Jul 06 15:49:42 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:43 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5ac0b7f2-75bd-4813-bafc-121b92cd99ee tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34" returned: 0 in 0.839s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5ac0b7f2-75bd-4813-bafc-121b92cd99ee tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:43 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1f6128ae-c937-414f-bf36-bbc8ee56c6f3 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2.752c2bd9-fd2f-4f5f-a310-64b4ade7f1f1" returned: 0 in 0.697s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:43 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34 Jul 06 15:49:43 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1f6128ae-c937-414f-bf36-bbc8ee56c6f3 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:43 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2.info Jul 06 15:49:43 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:44 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5ac0b7f2-75bd-4813-bafc-121b92cd99ee tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-31a2caf3-8d18-4cf9-a244-43a7181bac34" returned: 0 in 0.689s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5ac0b7f2-75bd-4813-bafc-121b92cd99ee tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-31a2caf3-8d18-4cf9-a244-43a7181bac34" released by "delete_volume" :: held 1.589s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:44 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1f6128ae-c937-414f-bf36-bbc8ee56c6f3 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2.info" returned: 0 in 0.705s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:44 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-1f6128ae-c937-414f-bf36-bbc8ee56c6f3 tempest-ProjectReaderTests-367541805 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2.info is being set with open permissions: ugo+rw Jul 06 15:49:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1f6128ae-c937-414f-bf36-bbc8ee56c6f3 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:44 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2.info Jul 06 15:49:44 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:44 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-5ac0b7f2-75bd-4813-bafc-121b92cd99ee tempest-ProjectMemberTests-765095290 None] Created reservations ['0f3c7697-8096-4258-b248-9902537f097f', 'df795b0e-429f-4d40-bcd9-201b2df1578a', '840577cc-56db-4e04-93cc-4e1f3f757331', '1bd516b6-cbba-41e6-8dca-933fc3824517'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:49:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5ac0b7f2-75bd-4813-bafc-121b92cd99ee tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5ac0b7f2-75bd-4813-bafc-121b92cd99ee tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5ac0b7f2-75bd-4813-bafc-121b92cd99ee tempest-ProjectMemberTests-765095290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:44 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-5ac0b7f2-75bd-4813-bafc-121b92cd99ee tempest-ProjectMemberTests-765095290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5ac0b7f2-75bd-4813-bafc-121b92cd99ee tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5ac0b7f2-75bd-4813-bafc-121b92cd99ee tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:44 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:49:44 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:44 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-1f6128ae-c937-414f-bf36-bbc8ee56c6f3 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2.info" returned: 0 in 0.723s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-1f6128ae-c937-414f-bf36-bbc8ee56c6f3 tempest-ProjectReaderTests-367541805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.626s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:44 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-1f6128ae-c937-414f-bf36-bbc8ee56c6f3 tempest-ProjectReaderTests-367541805 None] Create snapshot completed successfully Jul 06 15:49:44 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5ac0b7f2-75bd-4813-bafc-121b92cd99ee tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.718s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:44 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-5ac0b7f2-75bd-4813-bafc-121b92cd99ee tempest-ProjectMemberTests-765095290 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:49:44 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-5ac0b7f2-75bd-4813-bafc-121b92cd99ee tempest-ProjectMemberTests-765095290 None] Deleted volume successfully. Jul 06 15:49:44 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-5ac0b7f2-75bd-4813-bafc-121b92cd99ee tempest-ProjectMemberTests-765095290 None] Lock "cinder-31a2caf3-8d18-4cf9-a244-43a7181bac34-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Flow 'volume_create_manager' (59c9f700-e627-413c-b536-cb8fbe713e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed478d2-87e6-4b1e-8b26-98670a58476d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed478d2-87e6-4b1e-8b26-98670a58476d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1834690439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9faddb-0007-4ed8-be13-5f6a43641d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2acfd7a95ae04e6a8c97cbd4d6771d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:45Z,use_quota=True,user_id='c8e50c716ff74461bb8f1c33607ef860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a7d8af6-9f78-4597-9cef-f8698c944043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a7d8af6-9f78-4597-9cef-f8698c944043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f98121-2ccb-42cc-8557-8392f5a3c892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f98121-2ccb-42cc-8557-8392f5a3c892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd9faddb-0007-4ed8-be13-5f6a43641d71', 'volume_name': 'volume-cd9faddb-0007-4ed8-be13-5f6a43641d71', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d90661f-b20a-4133-9ad3-63f062fd9e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d90661f-b20a-4133-9ad3-63f062fd9e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a08035e8-1473-4675-bd55-c3a52f5228d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:45 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Volume cd9faddb-0007-4ed8-be13-5f6a43641d71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd9faddb-0007-4ed8-be13-5f6a43641d71', 'volume_size': 1} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1834690439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9faddb-0007-4ed8-be13-5f6a43641d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2acfd7a95ae04e6a8c97cbd4d6771d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:45Z,use_quota=True,user_id='c8e50c716ff74461bb8f1c33607ef860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Creating volume cd9faddb-0007-4ed8-be13-5f6a43641d71 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:49:45 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:45 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71 1073741824 Jul 06 15:49:45 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2a6bb77e-15cb-429f-a41a-241d7bab293f tempest-ProjectReaderTests-367541805 None] Acquiring lock "cinder-752c2bd9-fd2f-4f5f-a310-64b4ade7f1f1-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2a6bb77e-15cb-429f-a41a-241d7bab293f tempest-ProjectReaderTests-367541805 None] Lock "cinder-752c2bd9-fd2f-4f5f-a310-64b4ade7f1f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2a6bb77e-15cb-429f-a41a-241d7bab293f tempest-ProjectReaderTests-367541805 None] Acquiring lock "cinder-quobyte-170be4d8-aa86-4977-9f6e-1f96f9f247b2" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2a6bb77e-15cb-429f-a41a-241d7bab293f tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-170be4d8-aa86-4977-9f6e-1f96f9f247b2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2a6bb77e-15cb-429f-a41a-241d7bab293f tempest-ProjectReaderTests-367541805 None] Acquiring lock "cinder-quobyte-752c2bd9-fd2f-4f5f-a310-64b4ade7f1f1" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2a6bb77e-15cb-429f-a41a-241d7bab293f tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-752c2bd9-fd2f-4f5f-a310-64b4ade7f1f1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-2a6bb77e-15cb-429f-a41a-241d7bab293f tempest-ProjectReaderTests-367541805 None] Deleting offline snapshot 752c2bd9-fd2f-4f5f-a310-64b4ade7f1f1 of volume 170be4d8-aa86-4977-9f6e-1f96f9f247b2 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-2a6bb77e-15cb-429f-a41a-241d7bab293f tempest-ProjectReaderTests-367541805 None] snapshot_file for this snap is: volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2.752c2bd9-fd2f-4f5f-a310-64b4ade7f1f1 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[43088d97-c202-4fb0-88ea-62060ae23ed2]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2a6bb77e-15cb-429f-a41a-241d7bab293f tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2.752c2bd9-fd2f-4f5f-a310-64b4ade7f1f1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:45 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2.752c2bd9-fd2f-4f5f-a310-64b4ade7f1f1 Jul 06 15:49:45 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:46 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71 1073741824" returned: 0 in 0.821s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:46 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71 Jul 06 15:49:46 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:46 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2a6bb77e-15cb-429f-a41a-241d7bab293f tempest-ProjectReaderTests-367541805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2.752c2bd9-fd2f-4f5f-a310-64b4ade7f1f1" returned: 0 in 0.835s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-2a6bb77e-15cb-429f-a41a-241d7bab293f tempest-ProjectReaderTests-367541805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:49:46 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[a487a1ef-f5fd-4776-92ae-1f8b353eb000]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2a6bb77e-15cb-429f-a41a-241d7bab293f tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:46 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2 Jul 06 15:49:46 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:46 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71" returned: 0 in 0.635s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:46 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:49:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a08035e8-1473-4675-bd55-c3a52f5228d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd9faddb-0007-4ed8-be13-5f6a43641d71', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6edfc49-dd9a-48cd-b91c-283db0bcf3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:46 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Volume volume-cd9faddb-0007-4ed8-be13-5f6a43641d71 (cd9faddb-0007-4ed8-be13-5f6a43641d71): created successfully Jul 06 15:49:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6edfc49-dd9a-48cd-b91c-283db0bcf3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:46 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Flow 'volume_create_manager' (59c9f700-e627-413c-b536-cb8fbe713e37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:49:46 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-f6c91fbc-aa64-4e22-ac4d-b3495ca6ca51 tempest-ProjectMemberTests-765095290 None] Created volume successfully. Jul 06 15:49:47 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2a6bb77e-15cb-429f-a41a-241d7bab293f tempest-ProjectReaderTests-367541805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2" returned: 0 in 0.795s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2a6bb77e-15cb-429f-a41a-241d7bab293f tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2.752c2bd9-fd2f-4f5f-a310-64b4ade7f1f1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:47 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2.752c2bd9-fd2f-4f5f-a310-64b4ade7f1f1 Jul 06 15:49:47 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-405efe5b-8f1d-40bd-94f9-f148ceb613da tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-405efe5b-8f1d-40bd-94f9-f148ceb613da tempest-ProjectMemberTests-765095290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:47 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-405efe5b-8f1d-40bd-94f9-f148ceb613da tempest-ProjectMemberTests-765095290 None] Creating offline snapshot c05ac031-603f-45f4-8a42-8620c15b027b of volume cd9faddb-0007-4ed8-be13-5f6a43641d71 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:49:47 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[58514fdf-4152-48c2-8667-ae5ba25490ec]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-405efe5b-8f1d-40bd-94f9-f148ceb613da tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:47 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71 Jul 06 15:49:47 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:47 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2a6bb77e-15cb-429f-a41a-241d7bab293f tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2.752c2bd9-fd2f-4f5f-a310-64b4ade7f1f1" returned: 0 in 0.822s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2a6bb77e-15cb-429f-a41a-241d7bab293f tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2.752c2bd9-fd2f-4f5f-a310-64b4ade7f1f1 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:48 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2.752c2bd9-fd2f-4f5f-a310-64b4ade7f1f1 Jul 06 15:49:48 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:48 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-405efe5b-8f1d-40bd-94f9-f148ceb613da tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71" returned: 0 in 0.817s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-405efe5b-8f1d-40bd-94f9-f148ceb613da tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71.c05ac031-603f-45f4-8a42-8620c15b027b 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:48 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71.c05ac031-603f-45f4-8a42-8620c15b027b 1G Jul 06 15:49:48 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:48 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2a6bb77e-15cb-429f-a41a-241d7bab293f tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2.752c2bd9-fd2f-4f5f-a310-64b4ade7f1f1" returned: 0 in 0.706s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2a6bb77e-15cb-429f-a41a-241d7bab293f tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-752c2bd9-fd2f-4f5f-a310-64b4ade7f1f1" released by "_delete_snapshot" :: held 3.244s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2a6bb77e-15cb-429f-a41a-241d7bab293f tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-170be4d8-aa86-4977-9f6e-1f96f9f247b2" released by "delete_snapshot" :: held 3.267s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:48 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-2a6bb77e-15cb-429f-a41a-241d7bab293f tempest-ProjectReaderTests-367541805 None] Created reservations ['0275973a-b621-48e8-92bd-3046484d7cb5', 'fa34ff89-4639-45b5-b116-2f2bd78b819c', 'ae488ea7-4c5d-41be-a66b-62c66e0bf66a', 'df76f7bb-ab3d-4b5e-862f-9b11ef33882f'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:49:48 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-2a6bb77e-15cb-429f-a41a-241d7bab293f tempest-ProjectReaderTests-367541805 None] Delete snapshot completed successfully. Jul 06 15:49:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-2a6bb77e-15cb-429f-a41a-241d7bab293f tempest-ProjectReaderTests-367541805 None] Lock "cinder-752c2bd9-fd2f-4f5f-a310-64b4ade7f1f1-delete_snapshot" released by "delete_snapshot" :: held 3.436s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:49 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-405efe5b-8f1d-40bd-94f9-f148ceb613da tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71.c05ac031-603f-45f4-8a42-8620c15b027b 1G" returned: 0 in 0.853s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-405efe5b-8f1d-40bd-94f9-f148ceb613da tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd9faddb-0007-4ed8-be13-5f6a43641d71 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71.c05ac031-603f-45f4-8a42-8620c15b027b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:49 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd9faddb-0007-4ed8-be13-5f6a43641d71 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71.c05ac031-603f-45f4-8a42-8620c15b027b Jul 06 15:49:49 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:49 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-35ec45c7-cf87-4e47-a567-6b044288c61e tempest-ProjectReaderTests-367541805 None] Acquiring lock "cinder-170be4d8-aa86-4977-9f6e-1f96f9f247b2-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:49 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-35ec45c7-cf87-4e47-a567-6b044288c61e tempest-ProjectReaderTests-367541805 None] Lock "cinder-170be4d8-aa86-4977-9f6e-1f96f9f247b2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:49 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-35ec45c7-cf87-4e47-a567-6b044288c61e tempest-ProjectReaderTests-367541805 None] Acquiring lock "cinder-quobyte-170be4d8-aa86-4977-9f6e-1f96f9f247b2" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:49 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-35ec45c7-cf87-4e47-a567-6b044288c61e tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-170be4d8-aa86-4977-9f6e-1f96f9f247b2" acquired by "delete_volume" :: waited 0.015s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:49 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[88da3823-2cfd-4c39-ad5b-e0fa11f949a6]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-35ec45c7-cf87-4e47-a567-6b044288c61e tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:49 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-405efe5b-8f1d-40bd-94f9-f148ceb613da tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd9faddb-0007-4ed8-be13-5f6a43641d71 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71.c05ac031-603f-45f4-8a42-8620c15b027b" returned: 0 in 0.765s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:49 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-405efe5b-8f1d-40bd-94f9-f148ceb613da tempest-ProjectMemberTests-765095290 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71.c05ac031-603f-45f4-8a42-8620c15b027b is being set with open permissions: ugo+rw Jul 06 15:49:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-405efe5b-8f1d-40bd-94f9-f148ceb613da tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71.c05ac031-603f-45f4-8a42-8620c15b027b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:49 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71.c05ac031-603f-45f4-8a42-8620c15b027b Jul 06 15:49:49 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:49 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2 Jul 06 15:49:49 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:50 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-405efe5b-8f1d-40bd-94f9-f148ceb613da tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71.c05ac031-603f-45f4-8a42-8620c15b027b" returned: 0 in 0.719s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-405efe5b-8f1d-40bd-94f9-f148ceb613da tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:50 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-35ec45c7-cf87-4e47-a567-6b044288c61e tempest-ProjectReaderTests-367541805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2" returned: 0 in 0.790s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-35ec45c7-cf87-4e47-a567-6b044288c61e tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:50 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71.info Jul 06 15:49:50 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:50 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2 Jul 06 15:49:50 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:51 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-35ec45c7-cf87-4e47-a567-6b044288c61e tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-170be4d8-aa86-4977-9f6e-1f96f9f247b2" returned: 0 in 0.677s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:51 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-405efe5b-8f1d-40bd-94f9-f148ceb613da tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71.info" returned: 0 in 0.707s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:51 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-405efe5b-8f1d-40bd-94f9-f148ceb613da tempest-ProjectMemberTests-765095290 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71.info is being set with open permissions: ugo+rw Jul 06 15:49:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-405efe5b-8f1d-40bd-94f9-f148ceb613da tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:51 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-35ec45c7-cf87-4e47-a567-6b044288c61e tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-170be4d8-aa86-4977-9f6e-1f96f9f247b2" released by "delete_volume" :: held 1.540s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:51 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71.info Jul 06 15:49:51 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:51 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-35ec45c7-cf87-4e47-a567-6b044288c61e tempest-ProjectReaderTests-367541805 None] Created reservations ['17e4b80f-27cc-484f-92f9-46fa90e088a0', 'e70c2ed9-504e-478e-b898-5e2d1145f13c', '8c1ed4cd-290e-4423-87f0-0fbf56574cf7', 'de694c1d-a54b-4785-9f49-9ace74d4cb4f'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:49:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-35ec45c7-cf87-4e47-a567-6b044288c61e tempest-ProjectReaderTests-367541805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-35ec45c7-cf87-4e47-a567-6b044288c61e tempest-ProjectReaderTests-367541805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-35ec45c7-cf87-4e47-a567-6b044288c61e tempest-ProjectReaderTests-367541805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:51 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-35ec45c7-cf87-4e47-a567-6b044288c61e tempest-ProjectReaderTests-367541805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-35ec45c7-cf87-4e47-a567-6b044288c61e tempest-ProjectReaderTests-367541805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-35ec45c7-cf87-4e47-a567-6b044288c61e tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:51 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:49:51 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:51 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:51 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-405efe5b-8f1d-40bd-94f9-f148ceb613da tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71.info" returned: 0 in 0.705s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-405efe5b-8f1d-40bd-94f9-f148ceb613da tempest-ProjectMemberTests-765095290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.660s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:52 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-405efe5b-8f1d-40bd-94f9-f148ceb613da tempest-ProjectMemberTests-765095290 None] Create snapshot completed successfully Jul 06 15:49:52 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-35ec45c7-cf87-4e47-a567-6b044288c61e tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.687s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-35ec45c7-cf87-4e47-a567-6b044288c61e tempest-ProjectReaderTests-367541805 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:49:52 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-35ec45c7-cf87-4e47-a567-6b044288c61e tempest-ProjectReaderTests-367541805 None] Deleted volume successfully. Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-35ec45c7-cf87-4e47-a567-6b044288c61e tempest-ProjectReaderTests-367541805 None] Lock "cinder-170be4d8-aa86-4977-9f6e-1f96f9f247b2-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Flow 'volume_create_manager' (f321802b-0ded-4793-9882-90ea30e6d69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b39d2f-78e6-4c08-bfd2-56076fbb6656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b39d2f-78e6-4c08-bfd2-56076fbb6656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-777758320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6956a28-c2fc-48f3-9eb5-c2910fffca0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ef8b6d74c840deb320e6dead13534d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:52Z,use_quota=True,user_id='c05a8530934e4792bd47095b6f6e57b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc720ca-938f-4fd5-8c35-47b1dc6d03b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc720ca-938f-4fd5-8c35-47b1dc6d03b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520fc602-429c-4f0e-a395-b66f8c2d1538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520fc602-429c-4f0e-a395-b66f8c2d1538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6956a28-c2fc-48f3-9eb5-c2910fffca0e', 'volume_name': 'volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a446bf-c981-409a-8211-855695ab435a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a446bf-c981-409a-8211-855695ab435a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64dfa48d-24d6-4432-b647-b8b55534415e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:52 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Volume c6956a28-c2fc-48f3-9eb5-c2910fffca0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e', 'volume_size': 1} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-777758320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6956a28-c2fc-48f3-9eb5-c2910fffca0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ef8b6d74c840deb320e6dead13534d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:52Z,use_quota=True,user_id='c05a8530934e4792bd47095b6f6e57b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Creating volume c6956a28-c2fc-48f3-9eb5-c2910fffca0e {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:49:52 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:52 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e 1073741824 Jul 06 15:49:52 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-79a09493-6efd-41e6-b067-0b8a8389b741 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-c05ac031-603f-45f4-8a42-8620c15b027b-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-79a09493-6efd-41e6-b067-0b8a8389b741 tempest-ProjectMemberTests-765095290 None] Lock "cinder-c05ac031-603f-45f4-8a42-8620c15b027b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-79a09493-6efd-41e6-b067-0b8a8389b741 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-quobyte-cd9faddb-0007-4ed8-be13-5f6a43641d71" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-79a09493-6efd-41e6-b067-0b8a8389b741 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-cd9faddb-0007-4ed8-be13-5f6a43641d71" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-79a09493-6efd-41e6-b067-0b8a8389b741 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-quobyte-c05ac031-603f-45f4-8a42-8620c15b027b" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-79a09493-6efd-41e6-b067-0b8a8389b741 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-c05ac031-603f-45f4-8a42-8620c15b027b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-79a09493-6efd-41e6-b067-0b8a8389b741 tempest-ProjectMemberTests-765095290 None] Deleting offline snapshot c05ac031-603f-45f4-8a42-8620c15b027b of volume cd9faddb-0007-4ed8-be13-5f6a43641d71 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-79a09493-6efd-41e6-b067-0b8a8389b741 tempest-ProjectMemberTests-765095290 None] snapshot_file for this snap is: volume-cd9faddb-0007-4ed8-be13-5f6a43641d71.c05ac031-603f-45f4-8a42-8620c15b027b {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f61de56-1a92-4a82-93bc-537c5b875556]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:52 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-79a09493-6efd-41e6-b067-0b8a8389b741 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71.c05ac031-603f-45f4-8a42-8620c15b027b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:52 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71.c05ac031-603f-45f4-8a42-8620c15b027b Jul 06 15:49:52 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:53 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e 1073741824" returned: 0 in 0.883s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:53 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e Jul 06 15:49:53 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:53 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-79a09493-6efd-41e6-b067-0b8a8389b741 tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71.c05ac031-603f-45f4-8a42-8620c15b027b" returned: 0 in 0.866s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:53 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-79a09493-6efd-41e6-b067-0b8a8389b741 tempest-ProjectMemberTests-765095290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd9faddb-0007-4ed8-be13-5f6a43641d71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:49:53 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f0ead1-4cb3-4dab-869f-ff26dfc0b84a]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:53 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-79a09493-6efd-41e6-b067-0b8a8389b741 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:53 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71 Jul 06 15:49:53 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:54 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e" returned: 0 in 0.715s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:49:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64dfa48d-24d6-4432-b647-b8b55534415e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6692e5c9-1d29-437f-aa1a-2ebe23e4476f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:54 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Volume volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e (c6956a28-c2fc-48f3-9eb5-c2910fffca0e): created successfully Jul 06 15:49:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6692e5c9-1d29-437f-aa1a-2ebe23e4476f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:54 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Flow 'volume_create_manager' (f321802b-0ded-4793-9882-90ea30e6d69a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:49:54 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-2adfbb8c-6f81-4565-8387-aec75e28852f tempest-ProjectReaderTests-367541805 None] Created volume successfully. Jul 06 15:49:54 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-79a09493-6efd-41e6-b067-0b8a8389b741 tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71" returned: 0 in 0.771s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-79a09493-6efd-41e6-b067-0b8a8389b741 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71.c05ac031-603f-45f4-8a42-8620c15b027b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:54 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71.c05ac031-603f-45f4-8a42-8620c15b027b Jul 06 15:49:54 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5148d9af-c7f8-4b22-b973-a30f98808a96 tempest-ProjectReaderTests-367541805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5148d9af-c7f8-4b22-b973-a30f98808a96 tempest-ProjectReaderTests-367541805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:54 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-5148d9af-c7f8-4b22-b973-a30f98808a96 tempest-ProjectReaderTests-367541805 None] Creating offline snapshot 1f43196a-a941-47d4-8a95-0ed49c06c09f of volume c6956a28-c2fc-48f3-9eb5-c2910fffca0e {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:49:54 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d44481b-bddc-4bc6-b99d-fa0eae5b5043]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5148d9af-c7f8-4b22-b973-a30f98808a96 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:54 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e Jul 06 15:49:54 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:55 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-79a09493-6efd-41e6-b067-0b8a8389b741 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71.c05ac031-603f-45f4-8a42-8620c15b027b" returned: 0 in 0.754s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-79a09493-6efd-41e6-b067-0b8a8389b741 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71.c05ac031-603f-45f4-8a42-8620c15b027b {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:55 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71.c05ac031-603f-45f4-8a42-8620c15b027b Jul 06 15:49:55 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:55 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5148d9af-c7f8-4b22-b973-a30f98808a96 tempest-ProjectReaderTests-367541805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e" returned: 0 in 0.813s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5148d9af-c7f8-4b22-b973-a30f98808a96 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e.1f43196a-a941-47d4-8a95-0ed49c06c09f 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:55 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e.1f43196a-a941-47d4-8a95-0ed49c06c09f 1G Jul 06 15:49:55 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:55 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-79a09493-6efd-41e6-b067-0b8a8389b741 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71.c05ac031-603f-45f4-8a42-8620c15b027b" returned: 0 in 0.695s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-79a09493-6efd-41e6-b067-0b8a8389b741 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-c05ac031-603f-45f4-8a42-8620c15b027b" released by "_delete_snapshot" :: held 3.195s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:55 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-79a09493-6efd-41e6-b067-0b8a8389b741 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-cd9faddb-0007-4ed8-be13-5f6a43641d71" released by "delete_snapshot" :: held 3.228s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:55 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-79a09493-6efd-41e6-b067-0b8a8389b741 tempest-ProjectMemberTests-765095290 None] Created reservations ['0438d524-cae2-4379-825f-3e6e7245fde0', '25c02a55-9ca7-448a-a9f1-bd1a2c06adbf', '8fbbe41f-1a41-47a7-82af-5646c92b3f08', '04a3474c-b852-4c7e-9479-1524531150ad'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:49:56 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-79a09493-6efd-41e6-b067-0b8a8389b741 tempest-ProjectMemberTests-765095290 None] Delete snapshot completed successfully. Jul 06 15:49:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-79a09493-6efd-41e6-b067-0b8a8389b741 tempest-ProjectMemberTests-765095290 None] Lock "cinder-c05ac031-603f-45f4-8a42-8620c15b027b-delete_snapshot" released by "delete_snapshot" :: held 3.393s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:56 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5148d9af-c7f8-4b22-b973-a30f98808a96 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e.1f43196a-a941-47d4-8a95-0ed49c06c09f 1G" returned: 0 in 0.780s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5148d9af-c7f8-4b22-b973-a30f98808a96 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e.1f43196a-a941-47d4-8a95-0ed49c06c09f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:56 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e.1f43196a-a941-47d4-8a95-0ed49c06c09f Jul 06 15:49:56 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dce07c98-3069-4159-8305-408c0caf2773 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-cd9faddb-0007-4ed8-be13-5f6a43641d71-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dce07c98-3069-4159-8305-408c0caf2773 tempest-ProjectMemberTests-765095290 None] Lock "cinder-cd9faddb-0007-4ed8-be13-5f6a43641d71-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dce07c98-3069-4159-8305-408c0caf2773 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-quobyte-cd9faddb-0007-4ed8-be13-5f6a43641d71" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dce07c98-3069-4159-8305-408c0caf2773 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-cd9faddb-0007-4ed8-be13-5f6a43641d71" acquired by "delete_volume" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:56 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85cc93e-a799-4a8f-a6ed-a66efce61924]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dce07c98-3069-4159-8305-408c0caf2773 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:57 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5148d9af-c7f8-4b22-b973-a30f98808a96 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e.1f43196a-a941-47d4-8a95-0ed49c06c09f" returned: 0 in 0.744s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:57 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-5148d9af-c7f8-4b22-b973-a30f98808a96 tempest-ProjectReaderTests-367541805 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e.1f43196a-a941-47d4-8a95-0ed49c06c09f is being set with open permissions: ugo+rw Jul 06 15:49:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5148d9af-c7f8-4b22-b973-a30f98808a96 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e.1f43196a-a941-47d4-8a95-0ed49c06c09f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:57 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e.1f43196a-a941-47d4-8a95-0ed49c06c09f Jul 06 15:49:57 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:57 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71 Jul 06 15:49:57 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:57 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5148d9af-c7f8-4b22-b973-a30f98808a96 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e.1f43196a-a941-47d4-8a95-0ed49c06c09f" returned: 0 in 0.672s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5148d9af-c7f8-4b22-b973-a30f98808a96 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:57 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dce07c98-3069-4159-8305-408c0caf2773 tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71" returned: 0 in 0.791s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dce07c98-3069-4159-8305-408c0caf2773 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:57 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e.info Jul 06 15:49:57 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:57 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71 Jul 06 15:49:57 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:58 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5148d9af-c7f8-4b22-b973-a30f98808a96 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e.info" returned: 0 in 0.662s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:58 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-5148d9af-c7f8-4b22-b973-a30f98808a96 tempest-ProjectReaderTests-367541805 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e.info is being set with open permissions: ugo+rw Jul 06 15:49:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5148d9af-c7f8-4b22-b973-a30f98808a96 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:58 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dce07c98-3069-4159-8305-408c0caf2773 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-cd9faddb-0007-4ed8-be13-5f6a43641d71" returned: 0 in 0.662s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:58 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e.info Jul 06 15:49:58 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:58 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dce07c98-3069-4159-8305-408c0caf2773 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-cd9faddb-0007-4ed8-be13-5f6a43641d71" released by "delete_volume" :: held 1.516s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:58 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-dce07c98-3069-4159-8305-408c0caf2773 tempest-ProjectMemberTests-765095290 None] Created reservations ['ded21b2d-9832-4b26-ac09-02d38f93a1a8', '9a53c66c-31f6-4fc7-b959-f39cae02c36f', '818d9403-e7ca-4532-bd1f-d1e5299ab0c8', '9bced990-f547-4252-a7fa-57c7b96e507c'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:49:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-dce07c98-3069-4159-8305-408c0caf2773 tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-dce07c98-3069-4159-8305-408c0caf2773 tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:58 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-dce07c98-3069-4159-8305-408c0caf2773 tempest-ProjectMemberTests-765095290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:58 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-dce07c98-3069-4159-8305-408c0caf2773 tempest-ProjectMemberTests-765095290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-dce07c98-3069-4159-8305-408c0caf2773 tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dce07c98-3069-4159-8305-408c0caf2773 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:58 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:49:58 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:59 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-5148d9af-c7f8-4b22-b973-a30f98808a96 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e.info" returned: 0 in 0.729s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-5148d9af-c7f8-4b22-b973-a30f98808a96 tempest-ProjectReaderTests-367541805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.497s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:59 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-5148d9af-c7f8-4b22-b973-a30f98808a96 tempest-ProjectReaderTests-367541805 None] Create snapshot completed successfully Jul 06 15:49:59 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-dce07c98-3069-4159-8305-408c0caf2773 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.710s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-dce07c98-3069-4159-8305-408c0caf2773 tempest-ProjectMemberTests-765095290 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:49:59 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-dce07c98-3069-4159-8305-408c0caf2773 tempest-ProjectMemberTests-765095290 None] Deleted volume successfully. Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-dce07c98-3069-4159-8305-408c0caf2773 tempest-ProjectMemberTests-765095290 None] Lock "cinder-cd9faddb-0007-4ed8-be13-5f6a43641d71-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Flow 'volume_create_manager' (016ecaee-ea23-4c4f-aa78-8e4f728bad2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52586bb6-8a16-451f-ae4d-44ea69fbb31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52586bb6-8a16-451f-ae4d-44ea69fbb31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-547636824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db369954-7af9-4579-ada0-0e005bffa42e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2acfd7a95ae04e6a8c97cbd4d6771d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:50:00Z,use_quota=True,user_id='c8e50c716ff74461bb8f1c33607ef860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1f718c3-97a6-47a2-9d2f-84806876a999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1f718c3-97a6-47a2-9d2f-84806876a999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f36135f1-38e6-4990-9edd-33773fe8b8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f36135f1-38e6-4990-9edd-33773fe8b8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db369954-7af9-4579-ada0-0e005bffa42e', 'volume_name': 'volume-db369954-7af9-4579-ada0-0e005bffa42e', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b51c5e2c-c660-4e40-bc2d-c50c125eda4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b51c5e2c-c660-4e40-bc2d-c50c125eda4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51bf0b84-4155-41a0-97bc-bcbd4740739b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:59 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Volume db369954-7af9-4579-ada0-0e005bffa42e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db369954-7af9-4579-ada0-0e005bffa42e', 'volume_size': 1} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-547636824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db369954-7af9-4579-ada0-0e005bffa42e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2acfd7a95ae04e6a8c97cbd4d6771d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:50:00Z,use_quota=True,user_id='c8e50c716ff74461bb8f1c33607ef860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Creating volume db369954-7af9-4579-ada0-0e005bffa42e {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:49:59 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:59 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e 1073741824 Jul 06 15:49:59 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b4a2e7af-d905-4ea5-8e9e-541f65605517 tempest-ProjectReaderTests-367541805 None] Acquiring lock "cinder-1f43196a-a941-47d4-8a95-0ed49c06c09f-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b4a2e7af-d905-4ea5-8e9e-541f65605517 tempest-ProjectReaderTests-367541805 None] Lock "cinder-1f43196a-a941-47d4-8a95-0ed49c06c09f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b4a2e7af-d905-4ea5-8e9e-541f65605517 tempest-ProjectReaderTests-367541805 None] Acquiring lock "cinder-quobyte-c6956a28-c2fc-48f3-9eb5-c2910fffca0e" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b4a2e7af-d905-4ea5-8e9e-541f65605517 tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-c6956a28-c2fc-48f3-9eb5-c2910fffca0e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b4a2e7af-d905-4ea5-8e9e-541f65605517 tempest-ProjectReaderTests-367541805 None] Acquiring lock "cinder-quobyte-1f43196a-a941-47d4-8a95-0ed49c06c09f" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b4a2e7af-d905-4ea5-8e9e-541f65605517 tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-1f43196a-a941-47d4-8a95-0ed49c06c09f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-b4a2e7af-d905-4ea5-8e9e-541f65605517 tempest-ProjectReaderTests-367541805 None] Deleting offline snapshot 1f43196a-a941-47d4-8a95-0ed49c06c09f of volume c6956a28-c2fc-48f3-9eb5-c2910fffca0e {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-b4a2e7af-d905-4ea5-8e9e-541f65605517 tempest-ProjectReaderTests-367541805 None] snapshot_file for this snap is: volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e.1f43196a-a941-47d4-8a95-0ed49c06c09f {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef95335e-f9e4-4496-9fe6-fc2d61cb6772]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4a2e7af-d905-4ea5-8e9e-541f65605517 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e.1f43196a-a941-47d4-8a95-0ed49c06c09f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:00 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e.1f43196a-a941-47d4-8a95-0ed49c06c09f Jul 06 15:50:00 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:00 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e 1073741824" returned: 0 in 0.909s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:00 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e Jul 06 15:50:00 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:00 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4a2e7af-d905-4ea5-8e9e-541f65605517 tempest-ProjectReaderTests-367541805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e.1f43196a-a941-47d4-8a95-0ed49c06c09f" returned: 0 in 0.872s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:00 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-b4a2e7af-d905-4ea5-8e9e-541f65605517 tempest-ProjectReaderTests-367541805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:50:00 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[75171de1-0a36-431d-abd9-c9fb8a123a67]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:50:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4a2e7af-d905-4ea5-8e9e-541f65605517 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:01 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e Jul 06 15:50:01 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:01 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e" returned: 0 in 0.713s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:50:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:50:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51bf0b84-4155-41a0-97bc-bcbd4740739b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db369954-7af9-4579-ada0-0e005bffa42e', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:50:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d166f7da-5b25-48a6-abbc-6b61c0529130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:50:01 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Volume volume-db369954-7af9-4579-ada0-0e005bffa42e (db369954-7af9-4579-ada0-0e005bffa42e): created successfully Jul 06 15:50:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d166f7da-5b25-48a6-abbc-6b61c0529130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:50:01 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Flow 'volume_create_manager' (016ecaee-ea23-4c4f-aa78-8e4f728bad2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:50:01 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-f704a00d-9253-432a-a19d-deec3a34fbbb tempest-ProjectMemberTests-765095290 None] Created volume successfully. Jul 06 15:50:01 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4a2e7af-d905-4ea5-8e9e-541f65605517 tempest-ProjectReaderTests-367541805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e" returned: 0 in 0.828s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4a2e7af-d905-4ea5-8e9e-541f65605517 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e.1f43196a-a941-47d4-8a95-0ed49c06c09f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:01 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e.1f43196a-a941-47d4-8a95-0ed49c06c09f Jul 06 15:50:01 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3ea23859-c03c-42f1-86e8-b35676bb489a tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:50:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3ea23859-c03c-42f1-86e8-b35676bb489a tempest-ProjectMemberTests-765095290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:50:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-3ea23859-c03c-42f1-86e8-b35676bb489a tempest-ProjectMemberTests-765095290 None] Creating offline snapshot 85316a5d-ebe3-4473-9e8a-10fcac67cf4d of volume db369954-7af9-4579-ada0-0e005bffa42e {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:50:01 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3723839-c2df-4e82-b21d-bcd0ee343dae]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:50:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3ea23859-c03c-42f1-86e8-b35676bb489a tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:01 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e Jul 06 15:50:01 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:02 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4a2e7af-d905-4ea5-8e9e-541f65605517 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e.1f43196a-a941-47d4-8a95-0ed49c06c09f" returned: 0 in 0.813s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4a2e7af-d905-4ea5-8e9e-541f65605517 tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e.1f43196a-a941-47d4-8a95-0ed49c06c09f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:02 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e.1f43196a-a941-47d4-8a95-0ed49c06c09f Jul 06 15:50:02 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:02 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3ea23859-c03c-42f1-86e8-b35676bb489a tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e" returned: 0 in 0.817s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3ea23859-c03c-42f1-86e8-b35676bb489a tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e.85316a5d-ebe3-4473-9e8a-10fcac67cf4d 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:02 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e.85316a5d-ebe3-4473-9e8a-10fcac67cf4d 1G Jul 06 15:50:02 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:03 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b4a2e7af-d905-4ea5-8e9e-541f65605517 tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e.1f43196a-a941-47d4-8a95-0ed49c06c09f" returned: 0 in 0.701s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:03 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b4a2e7af-d905-4ea5-8e9e-541f65605517 tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-1f43196a-a941-47d4-8a95-0ed49c06c09f" released by "_delete_snapshot" :: held 3.313s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:50:03 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b4a2e7af-d905-4ea5-8e9e-541f65605517 tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-c6956a28-c2fc-48f3-9eb5-c2910fffca0e" released by "delete_snapshot" :: held 3.337s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:50:03 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-b4a2e7af-d905-4ea5-8e9e-541f65605517 tempest-ProjectReaderTests-367541805 None] Created reservations ['af4e846f-268a-423c-9226-3d37c537ba14', '241e0b73-97ae-43c0-8298-27c5c2eb60bd', '7f5dd05b-37e0-4f1d-af1a-0e71c7cf7baf', 'b9817216-8826-4663-904e-0dae4623f662'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:50:03 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-b4a2e7af-d905-4ea5-8e9e-541f65605517 tempest-ProjectReaderTests-367541805 None] Delete snapshot completed successfully. Jul 06 15:50:03 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-b4a2e7af-d905-4ea5-8e9e-541f65605517 tempest-ProjectReaderTests-367541805 None] Lock "cinder-1f43196a-a941-47d4-8a95-0ed49c06c09f-delete_snapshot" released by "delete_snapshot" :: held 3.476s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:50:03 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3ea23859-c03c-42f1-86e8-b35676bb489a tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e.85316a5d-ebe3-4473-9e8a-10fcac67cf4d 1G" returned: 0 in 0.883s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3ea23859-c03c-42f1-86e8-b35676bb489a tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db369954-7af9-4579-ada0-0e005bffa42e -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e.85316a5d-ebe3-4473-9e8a-10fcac67cf4d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:03 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db369954-7af9-4579-ada0-0e005bffa42e -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e.85316a5d-ebe3-4473-9e8a-10fcac67cf4d Jul 06 15:50:03 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:04 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-13eff2cd-3248-4d15-a0b6-5c07481b5ebf tempest-ProjectReaderTests-367541805 None] Acquiring lock "cinder-c6956a28-c2fc-48f3-9eb5-c2910fffca0e-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:50:04 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-13eff2cd-3248-4d15-a0b6-5c07481b5ebf tempest-ProjectReaderTests-367541805 None] Lock "cinder-c6956a28-c2fc-48f3-9eb5-c2910fffca0e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:50:04 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=122,cinder:INSERT=45,cinder:UPDATE=140,cinder:DELETE=16 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:50:04 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=113,cinder:INSERT=39,cinder:UPDATE=160,cinder:DELETE=8 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:50:04 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-13eff2cd-3248-4d15-a0b6-5c07481b5ebf tempest-ProjectReaderTests-367541805 None] Acquiring lock "cinder-quobyte-c6956a28-c2fc-48f3-9eb5-c2910fffca0e" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:50:04 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-13eff2cd-3248-4d15-a0b6-5c07481b5ebf tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-c6956a28-c2fc-48f3-9eb5-c2910fffca0e" acquired by "delete_volume" :: waited 0.021s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:50:04 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dd4c44-331b-4455-8faa-05ab537743a5]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:50:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-13eff2cd-3248-4d15-a0b6-5c07481b5ebf tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:04 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3ea23859-c03c-42f1-86e8-b35676bb489a tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db369954-7af9-4579-ada0-0e005bffa42e -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e.85316a5d-ebe3-4473-9e8a-10fcac67cf4d" returned: 0 in 0.726s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:04 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-3ea23859-c03c-42f1-86e8-b35676bb489a tempest-ProjectMemberTests-765095290 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e.85316a5d-ebe3-4473-9e8a-10fcac67cf4d is being set with open permissions: ugo+rw Jul 06 15:50:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3ea23859-c03c-42f1-86e8-b35676bb489a tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e.85316a5d-ebe3-4473-9e8a-10fcac67cf4d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:04 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e.85316a5d-ebe3-4473-9e8a-10fcac67cf4d Jul 06 15:50:04 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:04 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e Jul 06 15:50:04 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:04 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3ea23859-c03c-42f1-86e8-b35676bb489a tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e.85316a5d-ebe3-4473-9e8a-10fcac67cf4d" returned: 0 in 0.640s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3ea23859-c03c-42f1-86e8-b35676bb489a tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:04 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e.info Jul 06 15:50:04 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:05 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-13eff2cd-3248-4d15-a0b6-5c07481b5ebf tempest-ProjectReaderTests-367541805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e" returned: 0 in 0.772s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-13eff2cd-3248-4d15-a0b6-5c07481b5ebf tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:05 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e Jul 06 15:50:05 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:05 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3ea23859-c03c-42f1-86e8-b35676bb489a tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e.info" returned: 0 in 0.644s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:05 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-3ea23859-c03c-42f1-86e8-b35676bb489a tempest-ProjectMemberTests-765095290 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e.info is being set with open permissions: ugo+rw Jul 06 15:50:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3ea23859-c03c-42f1-86e8-b35676bb489a tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:05 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e.info Jul 06 15:50:05 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:05 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-13eff2cd-3248-4d15-a0b6-5c07481b5ebf tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-c6956a28-c2fc-48f3-9eb5-c2910fffca0e" returned: 0 in 0.665s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:05 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-13eff2cd-3248-4d15-a0b6-5c07481b5ebf tempest-ProjectReaderTests-367541805 None] Lock "cinder-quobyte-c6956a28-c2fc-48f3-9eb5-c2910fffca0e" released by "delete_volume" :: held 1.499s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:50:05 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-13eff2cd-3248-4d15-a0b6-5c07481b5ebf tempest-ProjectReaderTests-367541805 None] Created reservations ['4514c807-13f5-40df-b543-06c788740cdd', 'cc7e53d1-6a35-4aa8-ae9c-0d3457dcc2ba', '742eb604-fb2b-4d62-a2e1-f33774f33c05', '9f32b2d9-5ea0-4a0d-b5a2-fdb44e253f55'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:50:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-13eff2cd-3248-4d15-a0b6-5c07481b5ebf tempest-ProjectReaderTests-367541805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:50:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-13eff2cd-3248-4d15-a0b6-5c07481b5ebf tempest-ProjectReaderTests-367541805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:50:05 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-13eff2cd-3248-4d15-a0b6-5c07481b5ebf tempest-ProjectReaderTests-367541805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:50:05 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-13eff2cd-3248-4d15-a0b6-5c07481b5ebf tempest-ProjectReaderTests-367541805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:50:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-13eff2cd-3248-4d15-a0b6-5c07481b5ebf tempest-ProjectReaderTests-367541805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:50:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-13eff2cd-3248-4d15-a0b6-5c07481b5ebf tempest-ProjectReaderTests-367541805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:05 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:50:05 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:06 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3ea23859-c03c-42f1-86e8-b35676bb489a tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e.info" returned: 0 in 0.663s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3ea23859-c03c-42f1-86e8-b35676bb489a tempest-ProjectMemberTests-765095290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.456s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:50:06 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-3ea23859-c03c-42f1-86e8-b35676bb489a tempest-ProjectMemberTests-765095290 None] Create snapshot completed successfully Jul 06 15:50:06 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:06 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-13eff2cd-3248-4d15-a0b6-5c07481b5ebf tempest-ProjectReaderTests-367541805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.689s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:06 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-13eff2cd-3248-4d15-a0b6-5c07481b5ebf tempest-ProjectReaderTests-367541805 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:50:06 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-13eff2cd-3248-4d15-a0b6-5c07481b5ebf tempest-ProjectReaderTests-367541805 None] Deleted volume successfully. Jul 06 15:50:06 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-13eff2cd-3248-4d15-a0b6-5c07481b5ebf tempest-ProjectReaderTests-367541805 None] Lock "cinder-c6956a28-c2fc-48f3-9eb5-c2910fffca0e-delete_volume" released by "delete_volume" :: held 2.415s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:50:07 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f7e4ddb2-27a4-4324-924e-34bd7cd32c8c tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-85316a5d-ebe3-4473-9e8a-10fcac67cf4d-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:50:07 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f7e4ddb2-27a4-4324-924e-34bd7cd32c8c tempest-ProjectMemberTests-765095290 None] Lock "cinder-85316a5d-ebe3-4473-9e8a-10fcac67cf4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:50:07 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f7e4ddb2-27a4-4324-924e-34bd7cd32c8c tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-quobyte-db369954-7af9-4579-ada0-0e005bffa42e" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:50:07 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f7e4ddb2-27a4-4324-924e-34bd7cd32c8c tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-db369954-7af9-4579-ada0-0e005bffa42e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:50:07 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f7e4ddb2-27a4-4324-924e-34bd7cd32c8c tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-quobyte-85316a5d-ebe3-4473-9e8a-10fcac67cf4d" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:50:07 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f7e4ddb2-27a4-4324-924e-34bd7cd32c8c tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-85316a5d-ebe3-4473-9e8a-10fcac67cf4d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:50:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-f7e4ddb2-27a4-4324-924e-34bd7cd32c8c tempest-ProjectMemberTests-765095290 None] Deleting offline snapshot 85316a5d-ebe3-4473-9e8a-10fcac67cf4d of volume db369954-7af9-4579-ada0-0e005bffa42e {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:50:07 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-f7e4ddb2-27a4-4324-924e-34bd7cd32c8c tempest-ProjectMemberTests-765095290 None] snapshot_file for this snap is: volume-db369954-7af9-4579-ada0-0e005bffa42e.85316a5d-ebe3-4473-9e8a-10fcac67cf4d {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:50:07 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ac481e-80cb-47fe-aa41-1bcc783a07fb]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:50:07 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f7e4ddb2-27a4-4324-924e-34bd7cd32c8c tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e.85316a5d-ebe3-4473-9e8a-10fcac67cf4d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:07 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e.85316a5d-ebe3-4473-9e8a-10fcac67cf4d Jul 06 15:50:07 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:08 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f7e4ddb2-27a4-4324-924e-34bd7cd32c8c tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e.85316a5d-ebe3-4473-9e8a-10fcac67cf4d" returned: 0 in 0.833s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:08 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-f7e4ddb2-27a4-4324-924e-34bd7cd32c8c tempest-ProjectMemberTests-765095290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db369954-7af9-4579-ada0-0e005bffa42e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:50:08 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c211d65-3819-4d4d-b90c-fbdca8ede5dc]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:50:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f7e4ddb2-27a4-4324-924e-34bd7cd32c8c tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:08 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e Jul 06 15:50:08 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:08 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f7e4ddb2-27a4-4324-924e-34bd7cd32c8c tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e" returned: 0 in 0.826s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:08 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f7e4ddb2-27a4-4324-924e-34bd7cd32c8c tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e.85316a5d-ebe3-4473-9e8a-10fcac67cf4d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:09 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e.85316a5d-ebe3-4473-9e8a-10fcac67cf4d Jul 06 15:50:09 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:09 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f7e4ddb2-27a4-4324-924e-34bd7cd32c8c tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e.85316a5d-ebe3-4473-9e8a-10fcac67cf4d" returned: 0 in 0.787s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:09 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f7e4ddb2-27a4-4324-924e-34bd7cd32c8c tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e.85316a5d-ebe3-4473-9e8a-10fcac67cf4d {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:09 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e.85316a5d-ebe3-4473-9e8a-10fcac67cf4d Jul 06 15:50:09 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:10 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:10 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-f7e4ddb2-27a4-4324-924e-34bd7cd32c8c tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e.85316a5d-ebe3-4473-9e8a-10fcac67cf4d" returned: 0 in 0.639s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f7e4ddb2-27a4-4324-924e-34bd7cd32c8c tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-85316a5d-ebe3-4473-9e8a-10fcac67cf4d" released by "_delete_snapshot" :: held 3.203s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:50:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f7e4ddb2-27a4-4324-924e-34bd7cd32c8c tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-db369954-7af9-4579-ada0-0e005bffa42e" released by "delete_snapshot" :: held 3.229s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:50:10 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-f7e4ddb2-27a4-4324-924e-34bd7cd32c8c tempest-ProjectMemberTests-765095290 None] Created reservations ['ff475e08-2a2f-46ab-ac75-d6b08da056ad', '8eed7ca7-3993-4113-bbb4-040ba9db2996', '0ea5440a-fafe-4d60-8f13-328678703e8d', 'a7728db9-6b71-4870-83bc-57be91050e94'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:50:10 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-f7e4ddb2-27a4-4324-924e-34bd7cd32c8c tempest-ProjectMemberTests-765095290 None] Delete snapshot completed successfully. Jul 06 15:50:10 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-f7e4ddb2-27a4-4324-924e-34bd7cd32c8c tempest-ProjectMemberTests-765095290 None] Lock "cinder-85316a5d-ebe3-4473-9e8a-10fcac67cf4d-delete_snapshot" released by "delete_snapshot" :: held 3.364s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:50:11 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a33842f8-1e54-4713-a432-251442d3cf35 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-db369954-7af9-4579-ada0-0e005bffa42e-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:50:11 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a33842f8-1e54-4713-a432-251442d3cf35 tempest-ProjectMemberTests-765095290 None] Lock "cinder-db369954-7af9-4579-ada0-0e005bffa42e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:50:11 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a33842f8-1e54-4713-a432-251442d3cf35 tempest-ProjectMemberTests-765095290 None] Acquiring lock "cinder-quobyte-db369954-7af9-4579-ada0-0e005bffa42e" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:50:11 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a33842f8-1e54-4713-a432-251442d3cf35 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-db369954-7af9-4579-ada0-0e005bffa42e" acquired by "delete_volume" :: waited 0.021s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:50:11 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[e085a817-0eed-42d7-8113-73c6d788d159]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:50:11 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a33842f8-1e54-4713-a432-251442d3cf35 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:11 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e Jul 06 15:50:11 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:12 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a33842f8-1e54-4713-a432-251442d3cf35 tempest-ProjectMemberTests-765095290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e" returned: 0 in 0.731s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a33842f8-1e54-4713-a432-251442d3cf35 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:12 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e Jul 06 15:50:12 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:12 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:12 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a33842f8-1e54-4713-a432-251442d3cf35 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-db369954-7af9-4579-ada0-0e005bffa42e" returned: 0 in 0.613s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:12 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a33842f8-1e54-4713-a432-251442d3cf35 tempest-ProjectMemberTests-765095290 None] Lock "cinder-quobyte-db369954-7af9-4579-ada0-0e005bffa42e" released by "delete_volume" :: held 1.408s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:50:12 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-a33842f8-1e54-4713-a432-251442d3cf35 tempest-ProjectMemberTests-765095290 None] Created reservations ['6d30d2c8-359f-48e1-bfec-2f2ba8e40fde', 'b6a23a69-624f-4511-aefd-d062ebca79bb', '1d13beb7-2682-4099-8621-5e66d8f54581', '24f44c8f-f88e-4754-bce2-6f6fca9b8da0'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:50:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a33842f8-1e54-4713-a432-251442d3cf35 tempest-ProjectMemberTests-765095290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:50:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a33842f8-1e54-4713-a432-251442d3cf35 tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:50:13 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a33842f8-1e54-4713-a432-251442d3cf35 tempest-ProjectMemberTests-765095290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:50:13 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-a33842f8-1e54-4713-a432-251442d3cf35 tempest-ProjectMemberTests-765095290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:50:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-a33842f8-1e54-4713-a432-251442d3cf35 tempest-ProjectMemberTests-765095290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:50:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a33842f8-1e54-4713-a432-251442d3cf35 tempest-ProjectMemberTests-765095290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:13 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:50:13 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:13 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:13 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-a33842f8-1e54-4713-a432-251442d3cf35 tempest-ProjectMemberTests-765095290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.653s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:13 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-a33842f8-1e54-4713-a432-251442d3cf35 tempest-ProjectMemberTests-765095290 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:50:13 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-a33842f8-1e54-4713-a432-251442d3cf35 tempest-ProjectMemberTests-765095290 None] Deleted volume successfully. Jul 06 15:50:13 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-a33842f8-1e54-4713-a432-251442d3cf35 tempest-ProjectMemberTests-765095290 None] Lock "cinder-db369954-7af9-4579-ada0-0e005bffa42e-delete_volume" released by "delete_volume" :: held 2.294s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:50:23 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=16,cinder:UPDATE=25,cinder:INSERT=5 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:50:23 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=15,cinder:INSERT=8,cinder:UPDATE=19,cinder:DELETE=3 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:50:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:50:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:50:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:50:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:50:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:50:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:50:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:38 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:50:38 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:39 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.731s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:50:39 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager._thread_info {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:50:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread count: 28 {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:50:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread info: [<_MainThread(MainThread, started 124857273856128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:50:40 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:50:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Flow 'volume_create_manager' (5546302a-502d-4e31-805e-adb63466f22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:50:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea378bad-fcf0-4d68-908e-f33e839285b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:50:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea378bad-fcf0-4d68-908e-f33e839285b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-308058305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bd12402-c64e-4fe1-abf8-e8e3e358ff21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b614270f0e50473da1606f9ae9682c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:50:41Z,use_quota=True,user_id='3c85cf5706684718bbb480d9d00a3987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:50:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e50834ca-ea60-4589-be57-0aa89a7697b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:50:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e50834ca-ea60-4589-be57-0aa89a7697b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:50:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (606f5272-d394-4700-b4d5-dfa792ff99e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:50:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (606f5272-d394-4700-b4d5-dfa792ff99e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bd12402-c64e-4fe1-abf8-e8e3e358ff21', 'volume_name': 'volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:50:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b72bc1a-3e1a-4f2a-81a0-937f1afd77e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:50:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b72bc1a-3e1a-4f2a-81a0-937f1afd77e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:50:40 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (233881b6-50d1-4c42-8c17-d9d934f538b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:50:40 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Volume 5bd12402-c64e-4fe1-abf8-e8e3e358ff21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21', 'volume_size': 1} Jul 06 15:50:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:50:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:50:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-308058305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bd12402-c64e-4fe1-abf8-e8e3e358ff21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b614270f0e50473da1606f9ae9682c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:50:41Z,use_quota=True,user_id='3c85cf5706684718bbb480d9d00a3987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)}" {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:50:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Creating volume 5bd12402-c64e-4fe1-abf8-e8e3e358ff21 {{(pid=86148) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:50:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:50:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:50:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:50:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:50:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:50:40 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:50:40 devstack cinder-volume[86148]: INFO cinder.volume.drivers.remotefs [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] casted to osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce Jul 06 15:50:40 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21 1073741824 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:40 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21 1073741824 Jul 06 15:50:40 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:41 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21 1073741824" returned: 0 in 0.824s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:41 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:41 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21 Jul 06 15:50:41 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:42 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21" returned: 0 in 0.624s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:42 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'} {{(pid=86148) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:50:42 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:50:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (233881b6-50d1-4c42-8c17-d9d934f538b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21', 'volume_size': 1}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:50:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1181e094-516b-4329-87f0-ce74464d5bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:50:42 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Volume volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21 (5bd12402-c64e-4fe1-abf8-e8e3e358ff21): created successfully Jul 06 15:50:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1181e094-516b-4329-87f0-ce74464d5bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:50:42 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Flow 'volume_create_manager' (5546302a-502d-4e31-805e-adb63466f22a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:50:42 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-81b9cf47-cb7b-44f8-b276-5407abd5fb70 tempest-SnapshotDependencyTests-1373469790 None] Created volume successfully. Jul 06 15:50:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b8645145-dbf1-4f63-9785-1287f5dcc92a tempest-SnapshotDependencyTests-1373469790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:50:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b8645145-dbf1-4f63-9785-1287f5dcc92a tempest-SnapshotDependencyTests-1373469790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:50:43 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-b8645145-dbf1-4f63-9785-1287f5dcc92a tempest-SnapshotDependencyTests-1373469790 None] Creating offline snapshot b6c27068-3d50-4a5b-81da-a5ecee6dd95f of volume 5bd12402-c64e-4fe1-abf8-e8e3e358ff21 {{(pid=86148) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:50:43 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6f0eee-d41c-493c-84f7-1d640ffd4d7c]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:50:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b8645145-dbf1-4f63-9785-1287f5dcc92a tempest-SnapshotDependencyTests-1373469790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:43 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21 Jul 06 15:50:43 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:43 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b8645145-dbf1-4f63-9785-1287f5dcc92a tempest-SnapshotDependencyTests-1373469790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21" returned: 0 in 0.703s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:43 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b8645145-dbf1-4f63-9785-1287f5dcc92a tempest-SnapshotDependencyTests-1373469790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.b6c27068-3d50-4a5b-81da-a5ecee6dd95f 1G {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:43 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.b6c27068-3d50-4a5b-81da-a5ecee6dd95f 1G Jul 06 15:50:43 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:44 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b8645145-dbf1-4f63-9785-1287f5dcc92a tempest-SnapshotDependencyTests-1373469790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.b6c27068-3d50-4a5b-81da-a5ecee6dd95f 1G" returned: 0 in 0.783s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:44 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b8645145-dbf1-4f63-9785-1287f5dcc92a tempest-SnapshotDependencyTests-1373469790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.b6c27068-3d50-4a5b-81da-a5ecee6dd95f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:44 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.b6c27068-3d50-4a5b-81da-a5ecee6dd95f Jul 06 15:50:44 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:45 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b8645145-dbf1-4f63-9785-1287f5dcc92a tempest-SnapshotDependencyTests-1373469790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21 -F qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.b6c27068-3d50-4a5b-81da-a5ecee6dd95f" returned: 0 in 0.647s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:45 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-b8645145-dbf1-4f63-9785-1287f5dcc92a tempest-SnapshotDependencyTests-1373469790 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.b6c27068-3d50-4a5b-81da-a5ecee6dd95f is being set with open permissions: ugo+rw Jul 06 15:50:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b8645145-dbf1-4f63-9785-1287f5dcc92a tempest-SnapshotDependencyTests-1373469790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.b6c27068-3d50-4a5b-81da-a5ecee6dd95f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:45 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.b6c27068-3d50-4a5b-81da-a5ecee6dd95f Jul 06 15:50:45 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:45 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b8645145-dbf1-4f63-9785-1287f5dcc92a tempest-SnapshotDependencyTests-1373469790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.b6c27068-3d50-4a5b-81da-a5ecee6dd95f" returned: 0 in 0.636s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:45 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b8645145-dbf1-4f63-9785-1287f5dcc92a tempest-SnapshotDependencyTests-1373469790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:45 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.info Jul 06 15:50:45 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:46 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b8645145-dbf1-4f63-9785-1287f5dcc92a tempest-SnapshotDependencyTests-1373469790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.info" returned: 0 in 0.669s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:46 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-b8645145-dbf1-4f63-9785-1287f5dcc92a tempest-SnapshotDependencyTests-1373469790 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.info is being set with open permissions: ugo+rw Jul 06 15:50:46 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b8645145-dbf1-4f63-9785-1287f5dcc92a tempest-SnapshotDependencyTests-1373469790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.info {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:46 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.info Jul 06 15:50:46 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:47 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-b8645145-dbf1-4f63-9785-1287f5dcc92a tempest-SnapshotDependencyTests-1373469790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.info" returned: 0 in 0.630s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:47 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-b8645145-dbf1-4f63-9785-1287f5dcc92a tempest-SnapshotDependencyTests-1373469790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.150s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:50:47 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-b8645145-dbf1-4f63-9785-1287f5dcc92a tempest-SnapshotDependencyTests-1373469790 None] Create snapshot completed successfully Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG cinder.volume.flows.manager.create_volume [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86148) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Flow 'volume_create_manager' (00b88c48-49eb-41e5-80c0-7e87dcb67514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a24fc19f-30cc-4c1c-88d8-5c7fabf9f263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a24fc19f-30cc-4c1c-88d8-5c7fabf9f263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b0e743-fd79-43fa-b591-f6b7f686eab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b614270f0e50473da1606f9ae9682c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b6c27068-3d50-4a5b-81da-a5ecee6dd95f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:50:49Z,use_quota=True,user_id='3c85cf5706684718bbb480d9d00a3987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8da809b-2777-414e-9c57-c67f8e8437bc),volume_type_id=f8da809b-2777-414e-9c57-c67f8e8437bc)' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774bbcfb-f912-46d3-a7ca-fcf18f1d56ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774bbcfb-f912-46d3-a7ca-fcf18f1d56ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ed59fa-766c-4b82-a8bf-d2ccdb6172db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ed59fa-766c-4b82-a8bf-d2ccdb6172db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '73b0e743-fd79-43fa-b591-f6b7f686eab6', 'volume_name': 'volume-73b0e743-fd79-43fa-b591-f6b7f686eab6', 'volume_size': 1, 'snapshot_id': 'b6c27068-3d50-4a5b-81da-a5ecee6dd95f'}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (118dcbb4-3c8f-473e-9903-16060053521e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (118dcbb4-3c8f-473e-9903-16060053521e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef958dd8-7c29-4d80-972b-f847a21a3444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:50:48 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Volume 73b0e743-fd79-43fa-b591-f6b7f686eab6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-73b0e743-fd79-43fa-b591-f6b7f686eab6', 'volume_size': 1, 'snapshot_id': 'b6c27068-3d50-4a5b-81da-a5ecee6dd95f'} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Acquiring lock "cinder-quobyte-b6c27068-3d50-4a5b-81da-a5ecee6dd95f-73b0e743-fd79-43fa-b591-f6b7f686eab6" by "_create_volume_from_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Lock "cinder-quobyte-b6c27068-3d50-4a5b-81da-a5ecee6dd95f-73b0e743-fd79-43fa-b591-f6b7f686eab6" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Creating volume 73b0e743-fd79-43fa-b591-f6b7f686eab6 from snapshot b6c27068-3d50-4a5b-81da-a5ecee6dd95f {{(pid=86148) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Selected osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce as target Quobyte volume. {{(pid=86148) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Acquiring lock "cinder-quobyte-73b0e743-fd79-43fa-b591-f6b7f686eab6" by "_copy_volume_from_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Lock "cinder-quobyte-73b0e743-fd79-43fa-b591-f6b7f686eab6" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] snapshot: b6c27068-3d50-4a5b-81da-a5ecee6dd95f, volume: 73b0e743-fd79-43fa-b591-f6b7f686eab6, {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:50:48 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:50:49 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0ebd6e-8992-42fc-aa3f-e481a52b17e4]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:50:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.b6c27068-3d50-4a5b-81da-a5ecee6dd95f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:49 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.b6c27068-3d50-4a5b-81da-a5ecee6dd95f Jul 06 15:50:49 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:49 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.b6c27068-3d50-4a5b-81da-a5ecee6dd95f" returned: 0 in 0.739s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:50:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21 {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 15:50:49 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Creating direct copy from snapshot {{(pid=86148) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 15:50:49 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[1086b92f-f023-4f44-b0b3-b056c150dbae]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:50:49 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:49 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21 Jul 06 15:50:49 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:50 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21" returned: 0 in 0.771s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:50 devstack cinder-volume[86148]: DEBUG cinder.utils [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Path /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-73b0e743-fd79-43fa-b591-f6b7f686eab6 not found in is_blk_device check {{(pid=86148) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 15:50:50 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-73b0e743-fd79-43fa-b591-f6b7f686eab6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:50 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-73b0e743-fd79-43fa-b591-f6b7f686eab6 Jul 06 15:50:50 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:54 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-73b0e743-fd79-43fa-b591-f6b7f686eab6" returned: 0 in 4.132s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:54 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85ca0d1-7b9f-4d43-b6d7-498b3d5a005f]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:50:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:54 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21 Jul 06 15:50:54 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:55 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21" returned: 0 in 0.873s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:55 devstack cinder-volume[86148]: DEBUG cinder.image.image_utils [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21, size 1024.00 MB, duration 4.13 sec, destination /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-73b0e743-fd79-43fa-b591-f6b7f686eab6 {{(pid=86148) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:50:55 devstack cinder-volume[86148]: INFO cinder.image.image_utils [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Converted 1024.00 MB image at 247.77 MB/s Jul 06 15:50:55 devstack cinder-volume[86148]: WARNING cinder.volume.drivers.remotefs [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-73b0e743-fd79-43fa-b591-f6b7f686eab6 is being set with open permissions: ugo+rw Jul 06 15:50:55 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-73b0e743-fd79-43fa-b591-f6b7f686eab6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:55 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-73b0e743-fd79-43fa-b591-f6b7f686eab6 Jul 06 15:50:55 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:56 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-73b0e743-fd79-43fa-b591-f6b7f686eab6" returned: 0 in 0.604s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Lock "cinder-quobyte-73b0e743-fd79-43fa-b591-f6b7f686eab6" released by "_copy_volume_from_snapshot" :: held 7.210s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:50:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Lock "cinder-quobyte-b6c27068-3d50-4a5b-81da-a5ecee6dd95f-73b0e743-fd79-43fa-b591-f6b7f686eab6" released by "_create_volume_from_snapshot" :: held 7.238s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:50:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.252s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:50:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef958dd8-7c29-4d80-972b-f847a21a3444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73b0e743-fd79-43fa-b591-f6b7f686eab6', 'volume_size': 1, 'snapshot_id': 'b6c27068-3d50-4a5b-81da-a5ecee6dd95f'}' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:50:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c316d619-a81d-46b2-9df0-abfb868377d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:50:56 devstack cinder-volume[86148]: INFO cinder.volume.flows.manager.create_volume [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Volume volume-73b0e743-fd79-43fa-b591-f6b7f686eab6 (73b0e743-fd79-43fa-b591-f6b7f686eab6): created successfully Jul 06 15:50:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c316d619-a81d-46b2-9df0-abfb868377d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86148) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:50:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Flow 'volume_create_manager' (00b88c48-49eb-41e5-80c0-7e87dcb67514) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86148) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:50:56 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-273673da-8cc8-4244-93ec-4cfa14482acb tempest-SnapshotDependencyTests-1373469790 None] Created volume successfully. Jul 06 15:50:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-db88a8a6-5893-4bab-b6a5-ad62a6e7c1c2 tempest-SnapshotDependencyTests-1373469790 None] Acquiring lock "cinder-b6c27068-3d50-4a5b-81da-a5ecee6dd95f-delete_snapshot" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:50:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-db88a8a6-5893-4bab-b6a5-ad62a6e7c1c2 tempest-SnapshotDependencyTests-1373469790 None] Lock "cinder-b6c27068-3d50-4a5b-81da-a5ecee6dd95f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:50:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-db88a8a6-5893-4bab-b6a5-ad62a6e7c1c2 tempest-SnapshotDependencyTests-1373469790 None] Acquiring lock "cinder-quobyte-5bd12402-c64e-4fe1-abf8-e8e3e358ff21" by "delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:50:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-db88a8a6-5893-4bab-b6a5-ad62a6e7c1c2 tempest-SnapshotDependencyTests-1373469790 None] Lock "cinder-quobyte-5bd12402-c64e-4fe1-abf8-e8e3e358ff21" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:50:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-db88a8a6-5893-4bab-b6a5-ad62a6e7c1c2 tempest-SnapshotDependencyTests-1373469790 None] Acquiring lock "cinder-quobyte-b6c27068-3d50-4a5b-81da-a5ecee6dd95f" by "_delete_snapshot" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:50:56 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-db88a8a6-5893-4bab-b6a5-ad62a6e7c1c2 tempest-SnapshotDependencyTests-1373469790 None] Lock "cinder-quobyte-b6c27068-3d50-4a5b-81da-a5ecee6dd95f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:50:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-db88a8a6-5893-4bab-b6a5-ad62a6e7c1c2 tempest-SnapshotDependencyTests-1373469790 None] Deleting offline snapshot b6c27068-3d50-4a5b-81da-a5ecee6dd95f of volume 5bd12402-c64e-4fe1-abf8-e8e3e358ff21 {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:50:56 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-db88a8a6-5893-4bab-b6a5-ad62a6e7c1c2 tempest-SnapshotDependencyTests-1373469790 None] snapshot_file for this snap is: volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.b6c27068-3d50-4a5b-81da-a5ecee6dd95f {{(pid=86148) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:50:56 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8aca13e-b7dc-4b27-9ae9-e8cdea0c529a]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:50:56 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-db88a8a6-5893-4bab-b6a5-ad62a6e7c1c2 tempest-SnapshotDependencyTests-1373469790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.b6c27068-3d50-4a5b-81da-a5ecee6dd95f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:56 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.b6c27068-3d50-4a5b-81da-a5ecee6dd95f Jul 06 15:50:56 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:57 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-db88a8a6-5893-4bab-b6a5-ad62a6e7c1c2 tempest-SnapshotDependencyTests-1373469790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.b6c27068-3d50-4a5b-81da-a5ecee6dd95f" returned: 0 in 0.709s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:57 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.remotefs [None req-db88a8a6-5893-4bab-b6a5-ad62a6e7c1c2 tempest-SnapshotDependencyTests-1373469790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86148) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:50:57 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75f26eb-d72c-4883-9def-cff922c048fe]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:50:57 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-db88a8a6-5893-4bab-b6a5-ad62a6e7c1c2 tempest-SnapshotDependencyTests-1373469790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:57 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21 Jul 06 15:50:57 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:58 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-db88a8a6-5893-4bab-b6a5-ad62a6e7c1c2 tempest-SnapshotDependencyTests-1373469790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21" returned: 0 in 0.706s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-db88a8a6-5893-4bab-b6a5-ad62a6e7c1c2 tempest-SnapshotDependencyTests-1373469790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.b6c27068-3d50-4a5b-81da-a5ecee6dd95f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:58 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.b6c27068-3d50-4a5b-81da-a5ecee6dd95f Jul 06 15:50:58 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:58 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-db88a8a6-5893-4bab-b6a5-ad62a6e7c1c2 tempest-SnapshotDependencyTests-1373469790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.b6c27068-3d50-4a5b-81da-a5ecee6dd95f" returned: 0 in 0.712s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:58 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-db88a8a6-5893-4bab-b6a5-ad62a6e7c1c2 tempest-SnapshotDependencyTests-1373469790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.b6c27068-3d50-4a5b-81da-a5ecee6dd95f {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:58 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.b6c27068-3d50-4a5b-81da-a5ecee6dd95f Jul 06 15:50:58 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:59 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-db88a8a6-5893-4bab-b6a5-ad62a6e7c1c2 tempest-SnapshotDependencyTests-1373469790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21.b6c27068-3d50-4a5b-81da-a5ecee6dd95f" returned: 0 in 0.608s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-db88a8a6-5893-4bab-b6a5-ad62a6e7c1c2 tempest-SnapshotDependencyTests-1373469790 None] Lock "cinder-quobyte-b6c27068-3d50-4a5b-81da-a5ecee6dd95f" released by "_delete_snapshot" :: held 2.823s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:50:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-db88a8a6-5893-4bab-b6a5-ad62a6e7c1c2 tempest-SnapshotDependencyTests-1373469790 None] Lock "cinder-quobyte-5bd12402-c64e-4fe1-abf8-e8e3e358ff21" released by "delete_snapshot" :: held 2.844s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:50:59 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-db88a8a6-5893-4bab-b6a5-ad62a6e7c1c2 tempest-SnapshotDependencyTests-1373469790 None] Created reservations ['d4d1e09c-e19c-4d21-a9a4-75ea07c2b6fe', '74a3a4d9-f2e6-49a2-91fb-798e05724dba', 'a45730f1-4283-4bc0-9b3f-6ab9ed1f22ee', '7fd90c3d-59fb-4cd5-908d-fc3b574eb2ad'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:50:59 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-db88a8a6-5893-4bab-b6a5-ad62a6e7c1c2 tempest-SnapshotDependencyTests-1373469790 None] Delete snapshot completed successfully. Jul 06 15:50:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-db88a8a6-5893-4bab-b6a5-ad62a6e7c1c2 tempest-SnapshotDependencyTests-1373469790 None] Lock "cinder-b6c27068-3d50-4a5b-81da-a5ecee6dd95f-delete_snapshot" released by "delete_snapshot" :: held 2.970s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:50:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-00b0dfb2-438d-4467-8f72-d0d56d6febd8 tempest-SnapshotDependencyTests-1373469790 None] Acquiring lock "cinder-5bd12402-c64e-4fe1-abf8-e8e3e358ff21-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:50:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-00b0dfb2-438d-4467-8f72-d0d56d6febd8 tempest-SnapshotDependencyTests-1373469790 None] Lock "cinder-5bd12402-c64e-4fe1-abf8-e8e3e358ff21-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:50:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-00b0dfb2-438d-4467-8f72-d0d56d6febd8 tempest-SnapshotDependencyTests-1373469790 None] Acquiring lock "cinder-quobyte-5bd12402-c64e-4fe1-abf8-e8e3e358ff21" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:50:59 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-00b0dfb2-438d-4467-8f72-d0d56d6febd8 tempest-SnapshotDependencyTests-1373469790 None] Lock "cinder-quobyte-5bd12402-c64e-4fe1-abf8-e8e3e358ff21" acquired by "delete_volume" :: waited 0.014s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:50:59 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de5f7b4-95e3-4493-92ea-1f647e7bfeee]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:50:59 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-00b0dfb2-438d-4467-8f72-d0d56d6febd8 tempest-SnapshotDependencyTests-1373469790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:59 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21 Jul 06 15:50:59 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:00 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-00b0dfb2-438d-4467-8f72-d0d56d6febd8 tempest-SnapshotDependencyTests-1373469790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21" returned: 0 in 0.724s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:00 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-00b0dfb2-438d-4467-8f72-d0d56d6febd8 tempest-SnapshotDependencyTests-1373469790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:00 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21 Jul 06 15:51:00 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:01 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-00b0dfb2-438d-4467-8f72-d0d56d6febd8 tempest-SnapshotDependencyTests-1373469790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-5bd12402-c64e-4fe1-abf8-e8e3e358ff21" returned: 0 in 0.623s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:01 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-00b0dfb2-438d-4467-8f72-d0d56d6febd8 tempest-SnapshotDependencyTests-1373469790 None] Lock "cinder-quobyte-5bd12402-c64e-4fe1-abf8-e8e3e358ff21" released by "delete_volume" :: held 1.401s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:51:01 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-00b0dfb2-438d-4467-8f72-d0d56d6febd8 tempest-SnapshotDependencyTests-1373469790 None] Created reservations ['bee25671-424f-4b3c-bdb7-293ee1a6178d', '3eab3459-9c26-4594-a7b4-6f8c4080f858', '1f5ce82a-451f-438c-8a88-0b6853ce1f45', 'c8aa880b-533e-4729-989c-a254f04ee39f'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:51:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-00b0dfb2-438d-4467-8f72-d0d56d6febd8 tempest-SnapshotDependencyTests-1373469790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:51:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-00b0dfb2-438d-4467-8f72-d0d56d6febd8 tempest-SnapshotDependencyTests-1373469790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:51:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-00b0dfb2-438d-4467-8f72-d0d56d6febd8 tempest-SnapshotDependencyTests-1373469790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:51:01 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-00b0dfb2-438d-4467-8f72-d0d56d6febd8 tempest-SnapshotDependencyTests-1373469790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:51:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-00b0dfb2-438d-4467-8f72-d0d56d6febd8 tempest-SnapshotDependencyTests-1373469790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:51:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-00b0dfb2-438d-4467-8f72-d0d56d6febd8 tempest-SnapshotDependencyTests-1373469790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:01 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:51:01 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:01 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:01 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-00b0dfb2-438d-4467-8f72-d0d56d6febd8 tempest-SnapshotDependencyTests-1373469790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.640s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:01 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-00b0dfb2-438d-4467-8f72-d0d56d6febd8 tempest-SnapshotDependencyTests-1373469790 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:51:01 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-00b0dfb2-438d-4467-8f72-d0d56d6febd8 tempest-SnapshotDependencyTests-1373469790 None] Deleted volume successfully. Jul 06 15:51:01 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4b8595bb-835a-48fc-a46d-3d798d5754c9 tempest-SnapshotDependencyTests-1373469790 None] Acquiring lock "cinder-73b0e743-fd79-43fa-b591-f6b7f686eab6-delete_volume" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:51:01 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4b8595bb-835a-48fc-a46d-3d798d5754c9 tempest-SnapshotDependencyTests-1373469790 None] Lock "cinder-73b0e743-fd79-43fa-b591-f6b7f686eab6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:51:01 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-00b0dfb2-438d-4467-8f72-d0d56d6febd8 tempest-SnapshotDependencyTests-1373469790 None] Lock "cinder-5bd12402-c64e-4fe1-abf8-e8e3e358ff21-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:51:01 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4b8595bb-835a-48fc-a46d-3d798d5754c9 tempest-SnapshotDependencyTests-1373469790 None] Acquiring lock "cinder-quobyte-73b0e743-fd79-43fa-b591-f6b7f686eab6" by "delete_volume" {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:51:01 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4b8595bb-835a-48fc-a46d-3d798d5754c9 tempest-SnapshotDependencyTests-1373469790 None] Lock "cinder-quobyte-73b0e743-fd79-43fa-b591-f6b7f686eab6" acquired by "delete_volume" :: waited 0.018s {{(pid=86148) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:51:02 devstack cinder-volume[86148]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc02552-465a-4473-a2c7-6208bd1dbac1]: (4, 'qcow2') {{(pid=87025) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:51:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4b8595bb-835a-48fc-a46d-3d798d5754c9 tempest-SnapshotDependencyTests-1373469790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-73b0e743-fd79-43fa-b591-f6b7f686eab6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:02 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-73b0e743-fd79-43fa-b591-f6b7f686eab6 Jul 06 15:51:02 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:02 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4b8595bb-835a-48fc-a46d-3d798d5754c9 tempest-SnapshotDependencyTests-1373469790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-73b0e743-fd79-43fa-b591-f6b7f686eab6" returned: 0 in 0.746s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:02 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4b8595bb-835a-48fc-a46d-3d798d5754c9 tempest-SnapshotDependencyTests-1373469790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-73b0e743-fd79-43fa-b591-f6b7f686eab6 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:02 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-73b0e743-fd79-43fa-b591-f6b7f686eab6 Jul 06 15:51:02 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:03 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4b8595bb-835a-48fc-a46d-3d798d5754c9 tempest-SnapshotDependencyTests-1373469790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532/volume-73b0e743-fd79-43fa-b591-f6b7f686eab6" returned: 0 in 0.602s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:03 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4b8595bb-835a-48fc-a46d-3d798d5754c9 tempest-SnapshotDependencyTests-1373469790 None] Lock "cinder-quobyte-73b0e743-fd79-43fa-b591-f6b7f686eab6" released by "delete_volume" :: held 1.386s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:51:03 devstack cinder-volume[86148]: DEBUG cinder.quota [None req-4b8595bb-835a-48fc-a46d-3d798d5754c9 tempest-SnapshotDependencyTests-1373469790 None] Created reservations ['d57b32ae-9434-4954-9cf5-e2ba9fbf3487', '3900bd59-36b6-4d6b-a1bb-7229edcd2a79', '4ea4bb58-44ac-4aa3-abbe-c2d0b0d1f464', '3137db87-73ee-49ba-84e6-d390f4d894e8'] {{(pid=86148) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:51:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4b8595bb-835a-48fc-a46d-3d798d5754c9 tempest-SnapshotDependencyTests-1373469790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:51:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4b8595bb-835a-48fc-a46d-3d798d5754c9 tempest-SnapshotDependencyTests-1373469790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:51:03 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4b8595bb-835a-48fc-a46d-3d798d5754c9 tempest-SnapshotDependencyTests-1373469790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:51:03 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-4b8595bb-835a-48fc-a46d-3d798d5754c9 tempest-SnapshotDependencyTests-1373469790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:51:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-4b8595bb-835a-48fc-a46d-3d798d5754c9 tempest-SnapshotDependencyTests-1373469790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:51:03 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4b8595bb-835a-48fc-a46d-3d798d5754c9 tempest-SnapshotDependencyTests-1373469790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:03 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:51:03 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:04 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:04 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-4b8595bb-835a-48fc-a46d-3d798d5754c9 tempest-SnapshotDependencyTests-1373469790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.624s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:04 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-4b8595bb-835a-48fc-a46d-3d798d5754c9 tempest-SnapshotDependencyTests-1373469790 None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:51:04 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-4b8595bb-835a-48fc-a46d-3d798d5754c9 tempest-SnapshotDependencyTests-1373469790 None] Deleted volume successfully. Jul 06 15:51:04 devstack cinder-volume[86148]: DEBUG cinder.coordination [None req-4b8595bb-835a-48fc-a46d-3d798d5754c9 tempest-SnapshotDependencyTests-1373469790 None] Lock "cinder-73b0e743-fd79-43fa-b591-f6b7f686eab6-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=86148) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:51:13 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=24,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=6 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:51:14 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writing DB stats cinder:SELECT=24,cinder:INSERT=8,cinder:UPDATE=29,cinder:DELETE=2 {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:51:38 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:51:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:51:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:51:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce': None} {{(pid=86148) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:51:38 devstack cinder-volume[86148]: DEBUG cinder.volume.drivers.quobyte [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a4cb474-0511-4b98-8fda-8a21c3d3fcce'] {{(pid=86148) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:51:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86148) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:51:38 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:38 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532 Jul 06 15:51:38 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:39 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:39 devstack cinder-volume[86148]: DEBUG oslo_concurrency.processutils [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1f8637d1cf3d170e0cb5d1524024532" returned: 0 in 0.634s {{(pid=86148) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:39 devstack cinder-volume[86148]: DEBUG cinder.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Notifying Schedulers of capabilities ... {{(pid=86148) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:51:39 devstack cinder-volume[86148]: DEBUG oslo_service.periodic_task [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] Running periodic task VolumeManager._thread_info {{(pid=86148) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:51:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread count: 28 {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:51:39 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-3bc585e9-0974-47f4-8d6b-e43a900be6ad None None] thread info: [<_MainThread(MainThread, started 124857273856128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86148) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}